JP2008022154A - Makeup support apparatus and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a makeup support apparatus and method for saving on trouble of makeup and supporting the makeup. <P>SOLUTION: A makeup compact 2 includes a CCD camera 6, an LCD 7, a CPU 20, a face part identification detection section 31, an image correction section 32, and a makeup range coincidence discrimination section 33. A user draws eyebrows on the user's face and photographs the user's face by the CCD camera 6. The face part identification detection section 31 attaches face part detection data to the photographed image data and stores the resulting data to a RAM 26. The face part identification detection section 31 attaches face part detection data to image data resulting from photographing the user's face the day after the RAM 26 stores the image data and stores the resulting data to a buffer memory 22. An image correction section 32 corrects the new image data so that the size of eyes of the object person T (user) in the stored image data matches the size of eyes of the object person T in the new image data. The CPU 20 overlappingly displays a stored image P1 and a new image P2 on the LCD 7 so that the positions of the eyes of both the images match each other. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a makeup support apparatus and method for supporting makeup.

  When applying makeup, for example, in the case of eyebrow drawing, the eyebrow drawing pencil is used to draw a desired eyebrow shape. It is difficult to draw an eyebrow so as to obtain a desired eyebrow shape.In recent years, a desired eyebrow shape can be obtained by painting the hole portion with an eyebrow drawing pencil using an eyebrow template in which a hole having a desired eyebrow shape is formed. It has been proposed to draw.

  However, even when an eyebrow template is used to draw an eyebrow with a desired shape, there is dissatisfaction such that the position deviates from the desired position. In addition, makeup is time-consuming and sometimes painful. For this reason, techniques for reducing the labor of makeup have been proposed.

In Patent Document 1, a subject's face is imaged with a digital camera, the face image data is displayed on a display device, and according to the type selected by the subject among the four makeup image types of sweet, cool, cute, and fresh. A blusher makeup simulation system has been proposed in which blusher is applied and displayed on the cheek portion of a face image.
JP 2000-279228 A

  However, in Patent Document 1, makeup simulation can be performed on a display device. However, since makeup is applied using cosmetics and a makeup tool when makeup is actually performed, there is a problem in that the effort of makeup cannot be reduced. there were.

  The present invention has been made to solve the above-described problem, and provides a makeup support apparatus and method capable of reducing the effort of makeup reliably and providing support for applying makeup accurately. The purpose is to do.

  In order to achieve the above object, a makeup support apparatus according to the present invention includes a photographing unit that photographs a face of a subject who has applied makeup, a display unit that displays image data photographed by the photographing unit, and the photographing unit. Storage means for storing photographed image data, stored image data stored in the storage means, and new image data photographed by the photographing means after storing the stored image data in the storage means in the display means And a control means for displaying.

  Further, based on the new image data and the stored image data, based on the detection result of the facial part identification detection unit for identifying the part of the subject's face and detecting the position and size thereof, and the detection result of the facial part identification detection unit Correction means for correcting the display image size of at least one of the new image data and the stored image data so that the size of the face part in the new image data matches the size of the face part in the stored image data And the control means displays the new image data and the stored image data superimposed on the display means so that the positions of the face parts coincide with each other after being corrected by the correction means. preferable. In addition, it is preferable that the said face part identification detection means identifies a some face part, and detects each position and size.

  Further, the correction means corrects the face parts in the vicinity of the makeup range applied to the subject's face so that the sizes of the facial parts are the same, and the control means determines at least the makeup range and the face parts in the vicinity of the makeup range. It is preferable to display on the display means. Examples of the makeup range include an eyebrow drawing range, a lipstick application range, a mascara application range, a foundation application range, a blusher application range, and an eye shadow application range. The facial parts near the makeup range include eyes when the makeup range is an eyebrow range, a mascara application range, and an eye shadow application range, lips when the makeup range is a lipstick application range, and the makeup range. In the case of the foundation application range and blusher application range, the nose may be mentioned.

A determination unit that determines whether or not a makeup range applied to the face of the subject in the new image data matches a makeup range applied to the face of the subject in the stored image data;
It is preferable that a notification unit that notifies a determination result of the determination unit is provided. In addition, as said alerting | reporting means, LCD, a speaker, LED, etc. are mentioned.

  Further, the makeup assisting apparatus of the present invention is a photographing means for photographing a face of a subject to be makeupd, a display means for displaying image data photographed by the photographing means, and displayed on the display means. Based on the pre-makeup image data of the subject before makeup application based on the photographer's pre-makeup image data of the subject after makeup application photographed by the imaging means Analysis means for analyzing the image data within the specific range, determination means for determining whether the analysis result of the analysis means satisfies a preset element, and the determination result of the determination means And an informing means for informing. Examples of the specific range include a range of spots, wrinkles, moles, freckles, bruises, and the like that are desired to be hidden by makeup. In addition, examples of the preset element include hiding the specific range such as a stain by makeup.

  In addition, the makeup support method of the present invention stores image data obtained by photographing a face of a subject who has applied makeup, and stores the stored image data and the stored image data after the stored image data is stored. The image data is displayed on a display means.

  According to the makeup support apparatus of the present invention, since the stored image data and the new image data are displayed on the display means, the target person who is the user can check the display contents of the display means and simply apply the makeup previously applied. You can easily recognize the difference from the current makeup.

  In addition, since the new image data and the stored image data are displayed on the display means so that the positions of the facial parts match, the target user can more easily perform the makeup and the current makeup applied previously. You can easily recognize the difference between makeup.

  Further, according to the makeup support apparatus of the present invention, the image data within the specific range is analyzed by the analyzing means, it is determined whether or not the analysis result satisfies a preset element, and the determination result is notified. Therefore, the target person who is the user can easily recognize whether the specific range satisfies the preset element, for example, when the preset element is “stain is hidden” Can easily recognize whether the user wants to hide a stain due to makeup.

  In addition, according to the makeup support method of the present invention, the stored image data and the new image data are displayed on the display means. Therefore, the subject person who is the user performed the previous operation only by confirming the display contents on the display means. You can easily recognize the difference between makeup and current makeup.

  As shown in FIG. 1, a makeup compact (makeup support apparatus) 2 embodying the present invention includes a cover 3 and a compact body 4, and the cover 3 is attached to the compact body 4 by a hinge so as to be freely opened and closed. The makeup compact 2 can be switched between a photographing mode for photographing and a makeup support mode for supporting makeup.

  The cover 3 has a CCD camera unit (photographing means) 6 having a photographing lens 5, an LCD (display means) 7 for displaying photographed images and various setting conditions, a power button 8 for turning on / off the power, and photographing. A release button 9 that is sometimes pressed and a mode switch 10 that is operated when switching modes are provided.

  The release button 9 has a two-stage push structure. When the release button 9 is lightly pressed (half-pressed), a shooting preparation operation such as focusing is performed. When further pressed (fully pressed) in this state, a photographing operation is performed.

  The compact body 4 includes a cosmetic storage unit 11 for storing cosmetics such as a foundation and a mascara, a pencil storage unit 12 for storing an eyebrow pencil for drawing eyebrows, and menu keys for switching various settings and display images. 13 is provided.

  FIG. 2 is a block diagram showing an electrical configuration inside the makeup compact 2 according to the present invention, and a CCD 14 for imaging subject light transmitted through the photographing lens 5 is disposed behind the photographing lens 5. A timing signal (clock signal) is input to the CCD 14 from a timing generator 19 controlled by the CPU 20. The signal output from the CCD 14 is input to a correlated double sampling circuit (CDS) 15 and output as R, G, and B image data corresponding to the accumulated charge amount of each cell of the CCD 14 accurately. Image data output from the CDS 15 is amplified by an amplifier (AMP) 16 and converted into digital data by an A / D converter 17.

  The image input controller 18 is connected to the CPU 20 via the data bus 21, and controls the CCD 14, CDS 15, AMP 16, and A / D converter 17 according to instructions from the CPU 20. In addition, the image data output from the A / D converter 17 is written into the video memory 22 or the buffer memory 24.

  When the LCD 7 is used as a viewfinder, the video memory 22 temporarily stores image data having a low resolution. The image data recorded in the video memory 22 is sent to the LCD driver 23 via the data bus 21 and displayed on the LCD 7. The buffer memory 24 temporarily stores captured high-resolution image data. The image data read from the buffer memory 24 is stored in a RAM (storage means) 26 by a data reader that is driven and controlled by the memory controller 25.

  The image signal processing circuit 27 performs, for example, gradation conversion, color conversion, and hyper to compress the gradation of the ultra-low frequency density component of the image while the captured high-resolution image data is stored in the buffer memory 24. Image processing such as tone processing and hyper sharpness processing that enhances sharpness while suppressing graininess is performed.

  The face part identification detection unit 31 performs a plurality of face parts (hereinafter, referred to as a target person) of a photographed person (hereinafter referred to as a target person) based on the stored image data while the image data is stored in the buffer memory 24. Eyes, nose, lips, etc.) are identified and their positions and sizes are detected, and the detected face part detection data is added to the image data. That is, the RAM 26 stores image data to which face part detection data is added.

  The image correction unit 32 corrects the image data in response to the mode changeover switch 10 being operated to switch the makeup compact 2 to the makeup support mode. The image correction unit 32 uses the size of the face part (for example, eyes) of the subject in the image data (hereinafter referred to as stored image data) stored in the RAM 26 shown in FIG. 3, and the buffer memory shown in FIG. The display image size of the new image data is corrected so that the eye size of the subject in the image data stored in 24 (hereinafter referred to as new image data) matches. For example, when the size of the eye of the subject in the new image data is smaller than the size of the eye of the subject in the stored image data, correction for enlarging the new image data is performed. When a plurality of image data are stored in the RAM 26 (there are a plurality of stored image data), the user operates the menu key 13 to select one stored image data.

  As shown in FIG. 4B, when the new image data is corrected by the image correction unit 32, the CPU (control means) 20 displays the stored image P1 of the stored image data (solid lines in FIGS. 3 and 4B). And the new image P2 of the new image data (images indicated by solid lines in FIG. 4A and indicated by dotted lines in FIG. 4B) are superimposed on the LCD 7 so that the eye positions coincide with each other. indicate. At this time, a new image P2 is displayed on the stored image P1. Further, the CPU 20 displays the new image P2 in a blinking state, for example, in order to distinguish between the stored image P1 and the new image P2. As a result, the user can easily distinguish between the stored image P1 and the new image P2. Instead of the blinking display described above, the stored image P1 and the new image P2 may be distinguished by changing the color or displaying them alternately, and can be changed as appropriate.

  As shown in FIG. 2, a makeup range coincidence determination unit (determination means) 33 is provided inside the makeup compact 2, and the makeup range coincidence determination unit 33 is applied to the face of the subject in the stored image data. An eyebrow drawing range as a makeup range (hereinafter referred to as a stored eyebrow drawing range) and an eyebrow drawing range (hereinafter referred to as a new eyebrow drawing range) applied to the subject's face in the corrected new image data are detected. Then, the two detected eyebrow drawing ranges are compared to determine whether or not they match. The makeup range match determination unit 33 inputs a match signal to the CPU 20 when it is determined that they match, and when it determines that they do not match, it calculates a shift amount and does not match according to the shift amount. A signal is input to the CPU 20.

  In response to the input of the coincidence signal, the CPU 20 displays a comment image “The eyebrow drawing range is coincident” on the LCD 7, and responds to the input of the inconsistency signal in accordance with the amount of deviation. When the comment is shifted by 5 mm upward, for example, the comment image 40 “The eyebrow drawing range is shifted by 5 mm upward” is displayed on the LCD 7 (see FIG. 4B). In the present embodiment, the LCD 7 also functions as a notification unit that notifies the determination result of the makeup range matching determination unit 33.

  The effect | action of the makeup compact 2 comprised as mentioned above is demonstrated. The user (subject) draws an eyebrow on his / her face, puts the makeup compact 2 in the photographing mode, and operates the release button 9 to photograph his / her face. The captured image is temporarily stored in the buffer memory 24 as image data via the CCD 14, CDS 15, AMP 16, A / D converter 17, image input controller 18, and data bus 21. Note that the user can apply makeup while looking at his / her face displayed on the LCD 7 by using the LCD 7 as a viewfinder in the state where the makeup compact 2 is in the shooting mode.

  The face part identification detection unit 31 identifies a plurality of face parts (eyes, nose, lips) of the subject based on the stored image data while the image data is stored in the buffer memory 24. Each position and size is detected, and the detected face part detection data is added to the image data. The image data stored in the buffer memory 24 is stored in the RAM 26 by a data reader that is driven and controlled by the memory controller 25.

  When image data is stored in the RAM 26 (for example, the next day), the user performs eyebrow drawing on his / her face and determines whether or not it matches the previously applied eyebrow drawing range. The user operates the release button 9 to photograph his / her face. The captured image is temporarily stored in the buffer memory 24 as image data. The image data stored in the buffer memory 24 is added with face part detection data of each position and size of a plurality of face parts (eyes, nose, lips) of the subject detected by the face part identification detection unit 31. In this state, when the user operates the mode changeover switch 10 to switch the makeup compact 2 to the makeup support mode, the image correction unit 32 displays the size of the subject's eyes in the stored image data stored in the RAM 26, the buffer The display image size of the new image data is corrected so that the eye size of the subject in the new image data stored in the memory 24 matches.

  When the new image data is corrected by the image correction unit 32, the CPU 20 displays the stored image P1 and the new image P2 on the LCD 7 such that the eye positions coincide with each other. At this time, the new image P2 is displayed on the stored image P1, and the new image P2 is displayed in a blinking state in order to distinguish the stored image P1 from the new image P2.

  The makeup range coincidence determination unit 33 detects the stored eyebrow range of the stored image data and the new eyebrow range of the corrected new image data, and compares the two detected eyebrow ranges to determine whether they match. Determine whether or not. The makeup range coincidence determination unit 33 inputs a coincidence signal to the CPU 20 via the data bus 21 when it is determined that they are coincident, and calculates a deviation amount when it is determined that they do not coincide. A mismatch signal corresponding to the amount of deviation is input to the CPU 20.

  In response to the input of the coincidence signal, the CPU 20 displays a comment image “The eyebrow drawing range is coincident” on the LCD 7.

  On the other hand, the CPU 20 responds to the input of the mismatch signal, and if the comment image corresponding to the amount of deviation is, for example, 5 mm upward, the comment “The eyebrow drawing range is 5 mm upward” The image 40 is displayed on the LCD 7.

  As described above, the image correcting unit 32 adjusts the size of the eye of the subject in the stored image data stored in the RAM 26 and the size of the eye of the subject in the new image data stored in the buffer memory 24. After correcting the new image data, the stored image P1 and the new image P2 are superimposed and displayed on the LCD 7 so that the positions of the eyes coincide with each other. Therefore, the user can apply the makeup applied before and the makeup currently applied. You can easily recognize the difference and simply apply the eyebrow drawing so that the eyebrow drawing range of the stored image P1 matches the eyebrow drawing range of the new image P2. Can be applied.

  Further, since the CPU 20 displays the new image P2 in a blinking state, the user can easily distinguish between the stored image P1 and the new image P2.

  Furthermore, the makeup range coincidence determination unit 33 determines whether or not the stored eyebrow drawing range and the new eyebrow drawing range match, and when it is determined that they match, the CPU 20 determines that “the eyebrow drawing range is Since the comment image “matched” is displayed on the LCD 7, the user can easily recognize the match between the makeup applied before and the makeup currently applied.

  When the makeup range matching determination unit 33 determines that they do not match, the CPU 20 determines that the comment image corresponding to the amount of displacement, for example, 5 mm upward is shifted by “the eyebrow drawing range is shifted upward by 5 mm. Is displayed on the LCD 7, the user can easily recognize that the makeup applied before and the makeup currently applied do not match, and further, the deviation. The amount can also be recognized.

  In the above embodiment, it is determined whether the eyebrow drawing range applied to the subject in the stored image data and the new image data match. Without being limited to the eyebrow drawing range, the lipstick application range, mascara application range, foundation application range, blusher application range, eye shadow application range, and the like can be appropriately changed.

  In the above embodiment, image data obtained by photographing the user's own face is used as the stored image data. However, the present invention is not limited to this. For example, image data such as a model and a talent is stored in the RAM 26, and These image data may be used as stored image data.

  Furthermore, in the said embodiment, although the determination result of the makeup | decoration range match determination part 33 was displayed on LCD7, it is not limited to this, What is necessary is just to be able to alert | report the determination result of the makeup range match determination part 33, for example, The sound may be emitted from a speaker provided in the makeup compact 2.

  Moreover, in the said embodiment, although this invention was implemented in the makeup | decoration compact 2, this invention can be implemented also in a digital camera, a mobile telephone with a camera, etc.

  FIG. 5 shows another embodiment. Constituent members similar to those in the above embodiment are given the same reference numerals, and the detailed description thereof is simplified. In this embodiment, the makeup compact 2 determines whether the makeup applied to the subject is satisfactory. As shown in FIG. 5A, a pre-makeup image P3 of pre-makeup image data obtained by photographing the face of the user before makeup is displayed on the LCD 7, and the user presses the menu key 13 based on the pre-makeup image P3. To determine the specific range R of the subject's face (for example, the range of the stain S hidden by makeup). Then, after adding the specific range data indicating the determined specific range R to the pre-makeup image data, the pre-makeup image data is stored in the RAM 26. In the present embodiment, the menu key 13 also functions as a determination unit that determines the specific range R of the subject's face.

  Next, the user photographs his / her face with a satisfied makeup (a makeup that hides the stain S). As shown in FIG. 5B, the photographed makeup satisfaction image P4 is displayed on the LCD 7 and temporarily stored in the buffer memory 24 as makeup satisfaction image data. To this makeup satisfaction image data, face part detection data of the position and size of each of a plurality of face parts (eyes, nose, lips) of the subject detected by the face part identification detection unit 31 is added. In this state, when the makeup compact 2 is switched to the makeup support mode, the size of the eye of the subject in the makeup satisfaction image data matches the size of the eye of the subject in the pre-makeup image data stored in the RAM 26. The image correction unit 32 corrects the display image size of the makeup satisfaction image data.

  Then, the specific range data determined by the pre-makeup image data is also applied to the makeup satisfaction image data, and the CPU 20 calculates the density A of the entire face of the subject in the makeup satisfaction image data, and based on the density A. The density A1 of the specific range R, the average density A2 of the density range below the density A1, and the average density A3 of the density range above the density A1 are calculated, and each data of these density A1, average density A2, and average density A3 is calculated. After being added to the makeup satisfaction image data, the makeup satisfaction image data is stored in the RAM 26. In the present embodiment, the CPU 20 also functions as an analysis unit that analyzes image data within the specific range R.

  After the makeup satisfaction image data is stored in the RAM 26 (for example, the next day), when the user applies makeup to his / her face, the user photographs his / her face. The captured image is temporarily stored in the buffer memory 24 as determination image data. To this determination image data, face part detection data of the position and size of each of a plurality of face parts (eyes, nose, lips) of the subject detected by the face part identification detection unit 31 is added. In this state, when the makeup compact 2 is switched to the makeup support mode, the size of the eye of the subject in the determination image data matches the size of the eye of the subject in the pre-makeup image data stored in the RAM 26. The image correction unit 32 corrects the display image size of the determination image data. Then, the specific range data determined by the pre-makeup image data is also applied to the determination image data, and the CPU 20 calculates the density B of the entire face of the subject in the determination image data, and specifies based on the density B. The density B1 in the range R, the average density B2 in the density range below the density B1, and the average density B3 in the density range above the density B1 are calculated.

  The CPU 20 determines whether or not (average density B3−average density B2) ≦ (average density A3−average density A2) is satisfied. If the CPU 20 determines that the makeup is satisfied, the CPU 20 displays a comment image on the LCD 7 indicating that the makeup of this time is satisfactory (the stain S is hidden). If the CPU 20 determines that the makeup is not satisfied, A comment image indicating that the makeup of this time is not satisfactory (the stain S cannot be hidden) is displayed on the LCD 7. Thereby, the user can recognize whether the makeup which hides the stain S was performed easily. In the present embodiment, the CPU 20 determines whether or not the calculation result of the average density (density B, density B1, average density B2, and average density B3) as an analysis result satisfies a preset element. It also functions as a means.

  The specific range R is not limited to the range of the stain S, and can be appropriately changed such as a wrinkle range, a mole range, a freckles range, a bruise range, etc. to be hidden by makeup. It is also possible to make it.

It is a front perspective view which shows the makeup | decoration compact which implemented this invention. It is a block diagram which shows the electrical structure inside a makeup | decoration compact. It is a front view which shows LCD which displayed stored image data. It is a front view which shows LCD which displayed new image data, and LCD which displayed new image data and stored image data superimposed. It is a front view which shows LCD which displayed pre-makeup image data, and LCD which displayed makeup satisfaction image data.

Explanation of symbols

2 Makeup compact (makeup support device)
6 CCD camera unit (photographing means)
7 LCD (display means)
10 mode selector switch 13 menu key 20 CPU (control means)
26 RAM (storage means)
31. Face part identification detection unit (face part identification detection means)
32 Image correction unit (correction means)
33 makeup range coincidence determination unit (determination means)

Claims (6)

Photographing means for photographing the face of the subject to whom makeup is applied;
Display means for displaying image data photographed by the photographing means;
Storage means for storing image data photographed by the photographing means;
Control means for displaying, on the display means, stored image data stored in the storage means and new image data photographed by the photographing means after storing the stored image data in the storage means. Feature makeup support device. Based on the new image data and the stored image data, a facial part identification detecting means for identifying a face part of the subject and detecting its position and size;
Based on the detection result of the face part identification detection unit, the new image data and the stored image data are matched so that the size of the face part in the new image data matches the size of the face part in the stored image data. Correction means for correcting at least one display image size,
The control means, after being corrected by the correction means, displays the new image data and the stored image data superimposed on the display means so that the positions of face parts coincide with each other. The makeup support apparatus according to 1. The correction means corrects the facial parts in the vicinity of the makeup range applied to the subject's face so that the sizes of the facial parts match,
3. The makeup support apparatus according to claim 2, wherein the control means displays at least the makeup range and facial parts in the vicinity of the makeup range on the display means. Determining means for determining whether or not the makeup range applied to the face of the subject in the new image data matches the makeup range applied to the face of the subject in the stored image data;
The makeup support apparatus according to claim 2, further comprising a notification unit configured to notify a determination result of the determination unit. Photographing means for photographing the face of the subject to be applied;
Display means for displaying image data photographed by the photographing means;
Determining means for determining a specific range of the face of the subject based on the pre-makeup image data of the subject before the makeup that is displayed on the display means and photographed by the photographing means;
Analyzing means for analyzing the image data within the specific range based on the post-makeup image data of the subject after makeup taken by the photographing means;
Determination means for determining whether the analysis result of the analysis means satisfies a preset element;
A makeup support apparatus comprising: notification means for notifying the determination result of the determination means.   Image data obtained by photographing the face of the subject to whom makeup is applied is stored, and the stored image data and the new image data obtained by photographing the subject after the stored image data is stored are displayed on the display means. A makeup support method characterized by that.

Images