JP2002203238A - Formation of bare skin simulation image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To form a bare skin simulation image which enables a subject to grasp the impression of a face without makeup as an image in the case of realizing bare skin desired by the subject on the subject himself/herself. SOLUTION: A simulation image of bare skin corresponding to the desire of the subject is formed by applying image processing to the bare skin face image of the subject on the basis of hearing results with respect to a bare skin color desired by the subject. In such a case, in the image processing, a colorimetry value corresponding to the bare skin face image of the subject is changed on the basis of a database in relation to prescribed basic makeup applied to skin and the color or state of bare skin before and after the basic makeup within a range where the simulation image can be perceived as human skin in the case of displaying the simulation image on a monitor and also within a range where the bare skin color of the subject can be changed by the basic makeup according to the state of the skin.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method of forming a simulated image of bare skin for predicting and displaying how the skin of a subject is improved by basic makeup.

[0002]

2. Description of the Related Art Various basic cosmetics such as sunscreens, whitening cosmetics, moisturizers, blood circulation promoters, etc., are marketed in order to satisfy the desire to make the skin beautiful.

On the other hand, in order to obtain a desired cosmetic flesh color, various make-up cosmetics such as foundations are commercially available. Then, with respect to the makeup face when the predetermined makeup cosmetic is used for the subject, a simulation image is formed in order to be able to confirm that the makeup face is what the subject truly desires. In addition, a technique has been developed that allows the user to easily select a foundation necessary for realizing the makeup skin color of the simulation image by the subject.

[0004]

On the other hand, with regard to a real face, it has not been hitherto formed an impression that the subject wants to realize as a simulation image of the subject. As a result, no technique has been developed so far to show how much the skin of the subject is improved as an image.

Accordingly, the present invention enables an image to grasp the impression of the real face when the subject realizes the desired bare skin, and also allows the user to grasp, as an image, how the bare skin is improved by using the basic cosmetics. The purpose of the present invention is to form a simulation image of bare skin.

[0006]

The present inventor has obtained the following knowledge in developing a simulation image of bare skin. In forming a simulation image of a makeup face, the makeup skin color can be changed arbitrarily by appropriately selecting the color of the makeup cosmetic, so that the color of the face image of the subject can be freely changed as long as the subject desires. However, in forming a simulation image of the bare skin, there is a limit to the color that the bare skin can take, so that the color of the bare skin in the face image of the subject cannot be changed indefinitely as desired by the subject. In addition, the simulation image of the makeup face can be formed on the assumption that the makeup cosmetic uniformly conceals the original skin color, but in the formation of the simulation image of the bare skin, the effect of the basic makeup on the bare skin is the same. It is often unfavorable to apply uniform image processing to the entire skin, as it varies significantly depending on the state of skin pigmentation and the like.

Accordingly, the present invention provides a method of forming a simulation image of a bare skin according to the desire of a subject by performing image processing on a face image of the bare skin of the subject based on the result of hearing the color of the bare skin desired by the subject. In the image processing, within a range that can be perceived as human skin when a simulation image is displayed on a monitor, and within a range where the color of the subject's bare skin can change with the basic makeup depending on the skin condition, Based on the database on the predetermined basic makeup applied to and the skin color or state before and after the basic makeup,
Provided is a method of forming a simulation image of bare skin that changes a colorimetric value corresponding to a face image of the bare skin of a subject.

[0008] In particular, in the method of forming a simulated image, the image processing is performed on each of the pigmented area and the other area. An aspect is provided in which a parameter is obtained, and a plurality of simulation images are formed so as to show a temporal change when a subject applies a predetermined basic makeup to the skin based on the parameter.

Further, the present invention provides a method of basic makeup suitable for realizing a simulation image formed by the above-described method on the bare skin of a subject, a predetermined basic makeup applied to the skin and the bare skin before and after the basic makeup. Based on the database on the color or condition of the subject, a basic makeup advice method recommended to the subject is provided.

The present invention further provides, as a system for implementing the above-described method for forming a simulation image, image information acquiring means for acquiring a face image of a subject's bare skin, image processing of the face image of the subject's bare skin, and A simulation device for calculating a simulation image of the subject and a monitor for displaying image information, the system comprising: a monitor for displaying image information; Within the range that can be performed and within the range where the color of the subject's bare skin can be changed by the basic makeup depending on the condition of the skin, the listening result of the bare skin color desired by the subject, the predetermined basic makeup applied to the skin and its basic Change the colorimetric values corresponding to the face image of the subject's bare skin based on the database on the color or state of the bare skin before and after makeup So, to calculate a simulation image of the skin along the desired subject, to provide a forming system simulation images of skin.

[0011]

FIG. 1 is a flowchart showing an example of a method for forming a simulation image of bare skin according to the present invention, and FIG. 2 is a block diagram of an example of a system for implementing the method.

This system comprises an imaging device 1, a personal computer 2, and a monitor 3. The personal computer 2 further includes a colorimetric probe 4, an image scanner 5,
The printer 6 and the like are connected. The personal computer 2 can be connected to the Internet as needed. Here, the imaging apparatus 1 is provided as image information acquisition means for acquiring a face image of the subject's bare skin, and the personal computer body 2 performs image processing on the face image of the subject's bare skin to obtain a simulation image of the subject's bare skin. Is provided as calculation means for calculating The imaging device 1 and the monitor 3 are not particularly limited, and a commercially available color video camera and a monitor connected thereto can be used.

In the method of forming a simulation image using this system, first, a beauty engineer takes a face image of a subject's bare skin with the imaging device 1, displays the image on the monitor 3, and measures the color of the face image. As the colorimetric value, for example,
XYZ tristimulus values may be calculated from the RGB images displayed on the monitor 3 by a known method (Japanese Patent Laid-Open No. 7-17 / 1995).
No. 4631) and then L ^* a ^* b ^* may be further determined (JIS Z8722).

In addition, the face image of the subject's bare skin may be obtained from a color photograph of the subject's bare face using an image scanner, and a floppy (registered trademark) in which the subject's bare face image information is already stored. ) It may be read from any recording medium such as a disk, or may be obtained using a communication line such as the Internet. Therefore, in the system of the present invention, an image scanner, a reading mechanism of a recording medium, and a connection mechanism to a communication line such as the Internet may be provided as the image information obtaining means instead of the imaging device.

Further, the colorimetric value corresponding to the face image can be obtained by using a colorimetric probe or the like separately from the imaging of the face image.

At the time of color measurement, it is preferable to extract a pigmented area such as spots, freckles, moles, kuma, or nevus pigmentation, and to separately measure the pigmented area and other areas. For example, when a skin color is displayed as L ^* a ^* b ^* , (L _p0 ^* ,
a _p0 ^* , b _p0 ^* ) and the adjacent unpigmented region q
(L _q0 ^* , a _q0 ^* , b _q0 ^* ) are obtained as the colorimetric values of.

Next, the beauty technician interacts with the subject to hear the desired skin color, and based on the result, subjects the subject's face image to image processing such as blurring, brightness change, hue change, and the like. By performing the simulation, a simulation image of bare skin is formed in accordance with the wishes of the subject. In this case, by previously acquiring the correspondence between the various requests and the evaluation of the subject with respect to the image processing results from the data of a large number of subjects, for example, the concrete It is possible to cope with a desire as well as a desire with an abstract expression such as a desire to make the skin transparent.

In forming a simulation image of the bare skin, a basic makeup performed by using a predetermined agent on the skin by a predetermined method for a predetermined period, and a color, wrinkle, texture, etc. of the bare skin before and after the basic makeup are applied. A database constructed in advance for the state is used. By confirming which data in the database was used to form a simulation image of a given subject, a basic makeup method suitable for making the subject's bare skin in line with the wishes of the subject was found, Can be recommended to the subject.

More specifically, for example, it is desired to make pores, acne scars, spots, freckles, etc. inconspicuous, and to make the skin transparent, bright, fluffy, and soft. For an abstract request, a simulation image is formed using a blurring method of image processing software. In addition, as a basic makeup method corresponding to these demands, it is recommended to use a lotion, a milky lotion, a serum, etc. having a high moisturizing effect on the entire face, and to use a keratin remover for a specific site.

For a specific desire to make wrinkles less noticeable and an abstract desire to give the skin a sense of transparency, brightness, softness and softness, a multi-layer method of image processing software is used. Is used to conceal wrinkles.
As a basic makeup method for concealing wrinkles, it is recommended to use a moisturizer or a pack for the entire face or a site where wrinkles occur.

For a specific desire to lighten the complexion, to make the spots and freckles less noticeable, and to provide an abstract desire to make the skin transparent, bright and clean, an image processing software To perform lightness increase and color tone correction. In addition, as a basic makeup method for this purpose, use of a spot whitening agent, a blood circulation enhancer, a massage agent for the whole face or spots and spots where freckles occur, and use of a milky lotion, a serum, etc. having a high moisturizing effect on the whole face. Recommend.

As specific wishes, even if the desire to lighten the complexion or to make the spots and freckles less noticeable, as an abstract wish, a tight feeling, a clear feeling, or a healthy feeling If you want to make it look like that, you can use image processing software to perform brightness reduction and color tone correction. Also, as a basic makeup method for this,
We recommend the use of a tanning agent on all faces.

When the user wants to make the skin look firm, fresh, firm, elastic, youthful, and bright, the color tone is corrected using image processing software. As a basic makeup method for this purpose, it is recommended to use a blood circulation promoter, a massage agent, a lotion, a milky lotion, a serum, etc. having a high moisturizing effect on the whole face.

In the present invention, the simulation image is formed so as to be within the range of the maximum color system display that can be perceived as human skin when the simulation image is displayed on the monitor. It is formed so that the color of the bare skin or the state of wrinkles, textures, and the like is in the maximum range that can be changed by a predetermined basic makeup. The latter range can be obtained from the above-mentioned database relating to the color or condition of the bare skin before and after a given basic makeup.

For example, when the skin color is represented by L ^* a ^* b ^* , the skin color of the subject is (L ₀ ^* , a ₀ ^* , b ₀ ^* ), and the skin color of the simulation image is (L ₀ ^* , a ₀ ^* , b ₀ ^* ). ₁ ^*, a ₁ ^*, the b ₁ ^*) and to, when it is displayed on the monitor, the range of maximum simulation image that may perceived as the color of the skin of the dye non-deposited area, L ₁ ^* = 0 to 100 , A ₁ ^* = − 20 to 50 and b ₁ ^* = − 20 to 50.

Further, regarding the difference between the skin color of the simulation image and the skin color of the bare skin of the subject, L ₁ ^* −L ₀ ^* = ΔL ₀ ^* , a ₁ ^* −a ₀ ^* = Δa ₀ ^* , b ₁ ^* −b ₀ ^* = Δb ₀ ^* , ΔL ₀ ^* , Δa ₀ ^* , Δb in the non-pigmented area
The maximum fluctuation range of ₀ ^* is −30 <ΔL ₀ ^* <30, −20 <Δa ₀ ^* <20, −20 <Δb ₀ ^* <20 from the aforementioned database.

Thus, for example, non-pigmentation of a subject
The skin color of the bare skin in the region₀ ^*, A₀ ^*, B₀ ^*) = (70,5,1
In the case of 0), the skin color that the simulation image can take
(L₁ ^*, A₁ ^*, B₁ ^*) Is 40.0 <L₁ ^*<100.0, -15 <a₁ ^*<25.0, -10 <b₁ ^*<30.0. Therefore, the subject's desire is to make the skin lighter
In the simulation image, ΔL₀ ^*<30 limited
L each time₁ ^*And the subject's desire increases redness on the bare skin
In the direction, Δa₀ ^*A up to 20₁ ^*Increase
If the subject's desire is to reduce yellowness from bare skin
If Δb₀ ^*> −20 b₁ ^*Decrease.

If the subject's desire for bare skin exceeds this range, it is not usually possible to achieve the subject's desired skin color with basic makeup, so the subject is informed and, if necessary, makeup makeup such as a foundation. Encourage the use of fees.

Pigmented areas such as spots, freckles, moles, kuma, and nevus pigmentation have different effects from the non-pigmented areas and the basic makeup. Is not changed by the basic makeup (that is, ΔL ₀ ^* = 0, Δa ₀ ^* = 0, Δb ₀ ^* =
0) It is preferable to extract the pigmented region from the face image of the subject and determine the color in the simulation image separately from the other regions.

In the pigmented area, whether the pigmentation is due to nevus pigmentation or other pigmentation (non-nevular pigmentation) can be determined by visual observation by a beauty technician. As a method for extracting a pigmented area, an L ^* component image is extracted from a bare skin image (RGB image) of a subject, information on contrast change is obtained through a DOG (Difference of Gaussian) filter, and an output value through a DOG filter is obtained. Method for extracting color shading areas by setting a threshold value on the image
1993 autumn conference research report IB-06) and a moving average method for smoothing the entire image and extracting a portion having a large color difference from the color difference (ΔL ^* , ΔE ^* ) from the image before smoothing (Masuda et al. So
c. Cosmet. Chem. Japan, Vol. 28 (No. 2), p147 (1994)) and the like can be used.

Regarding the color of the non-necrotic pigmentation region in the simulation image, for example, in the face image of the subject's bare skin, the colorimetric value of the stain p is (L _p0 ^* , a _p0 ^* , b
_p0 ^* ), the colorimetric value of the non-pigmented area q adjacent thereto is ( _Lq0 ^* , _aq0 ^* , _bq0 ^* ), and the change before and after the simulation of the non-pigmented area is _ΔLq0 ^* , Δa _q0 ^* ,
In the case of Δb _q0 ^* , the changes ΔL _p0 ^* , Δa _p0 ^* , Δb _p0 ^* before and after the simulation of the pigmentation area are ΔL _p0 ^* = αΔL _q0 ^{* ,} Δa _p0 ^* = βΔa _q0 ^{* ,} Δb _p0 ^* = The coefficients α, β, and γ satisfying γΔb _q0 ^* can be obtained by obtaining them from the aforementioned database.

Alternatively, since L ^* in the face image of the subject's skin is lower in the pigmented area such as a stain than in the non-pigmented area, ΔL ₀ ^* becomes larger than that in the non-pigmented area. Therefore, the color of the pigmented area in the simulation image may be determined according to the size of ΔL ₀ ^* .

In the present invention, as described above, the range of the colorimetric display of the simulation image of the bare skin is limited. In addition, when the simulation image is formed using the blurring method, the degree of the blurring is set. Also, it is preferable to set a predetermined limit. The limit of the degree of blur can be determined from image measurements before and after bathing, before and after packs, before and after aesthetic treatment, and image measurements before and after continuous use tests of predetermined cosmetics, regarding the smoothness of texture and the difficulty of seeing pores. it can. Further, the preferable degree of the blur varies depending on the magnification of the image. Therefore, in the simulation image, it is preferable to define the blur by the variable δ of the Gaussian filter based on the skin size. For example, { _δ (x, y) = (１ ／ πδ ² ) · exp} −
When (x ² + y ² ) / 2δ ² }, δ = 0.01 mm
〜1 mm, and the output value by the convolution of the Gaussian filter and the image is used in the simulation image.

In the present invention, it is preferable that the formation of the simulated image also shows the temporal change of the bare skin. Therefore, in the above-described database, a parameter of a temporal change of the color of the bare skin in the color space is obtained, and based on the parameter, a change of the bare skin when the subject applies a predetermined basic makeup to the skin is shown over time. Preferably, a plurality of simulation images are formed. For example, the following parameters s, t, and
u can be assumed.

ΔL ₀ ^* = s (100−L ₀ ^* ), s = 0−0.5 × 7 / (10−
m), Δa ₀ ^* = t × a ₀ ^* , t = 0 to ± 1.5 × 7 / (10−m), Δb ₀ ^* = u × b ₀ ^* , u = 0 to ± 1.5 × 7 / (10−m) m) (where m is 1, 2 or 3 and represents a continuous use period (months) of the whitening cosmetic. s = t = u ≠ 0 When t ≧ 0, s> 0 or u <0 u ≧ S> 0 or t <0 when 0, t <0 or u <0 when s = 0

In the above equations of s, t and u, m = 1,
Assuming 2, 3, the fraction terms are 7/9, 7/8, 7/7, and 3
It can be seen that the effects ΔL ₀ ^* , Δa ₀ ^* , Δb ₀ ^* of the whitening cosmetics become maximum in months. These parameters s, t, u are
In consideration of the colorimetric values (L ₀ ^* , a ₀ ^* , b ₀ ^* ) of the subject's bare skin, it is determined from the database for each type of basic cosmetic applied to the bare skin, application method, and the like.

As a specific example of the simulation of the bare skin using the parameters s, t, and u, a skin whitening (L ₀ ^* , a ₀ ^* , b ₀ ^* ) = (55.0, 5.00, 10.0) When s = 0.5, t = -1.5 and u = 0.00 are obtained from the database as parameters when the whitening effect is greatest when the cosmetic is used for three months, (L ₀ ^* , a ₀ ^* , b ₀ ^* ) = (55.0, 5.00, 1
To the skin of the subject's 0.0), whitening cosmetics using three months, when the whitening effect is assumed to appear in the ^{_{maximum, (L 1 *, a 1}} *,
b ₁ ^* ) = (77.5, −2.50, 10.0) is presented in a simulation image.

Similarly, when the whitening cosmetic is used for two months, the parameters are s = 0.5 × 7/8 = 0.44, t = −1.5 × 7/8 = −1.31, u =
Since 0.00 × 7/8 = 0.00, it is assumed that the whitening cosmetic is used for two months and that the whitening effect appears to the maximum, (L ₁ ^* , a ₁ ^* ,
b ₁ ^* ) = (74.8, -1.55, 10.0) is presented in the simulation image, and when the whitening cosmetic is used for one month, the parameter is s = 0.5 × 7/9 = 0.39, t = −1.5 × 7/9 = −1.17, u =
Since 0.00 × 7/9 = 0.00, it is assumed that the whitening cosmetic is used for one month and the whitening effect appears to the maximum, and (L ₁ ^* , a ₁ ^* ,
b ₁ ^* ) = (72.6, -0.85, 10.0) is presented in a simulation image to be skin.

In the present invention, the method of displaying the simulation image on the monitor is not particularly limited. The simulation images after one month, two months, and three months following the above-described temporal change are appropriately switched as shown in FIG. 3 and displayed on the monitor at the same time as the face image of the current subject's bare skin. Is also good. In addition, as shown in FIG. 4, simulation images after one month, two months, and three months may be simultaneously displayed on a monitor together with a face image of the skin of the current subject,
Further, along with these, the image that the subject may ideally may be displayed.

Further, as a simulation image, a plurality of simulation screens showing the individual differences in the effect when the same basic makeup is applied to skin having substantially the same color or state may be created and displayed. For example, three whitening cosmetics
A simulation image corresponding to the parameter (s = 0.5, t = -1.5, u = 0.00) when the whitening effect appears at the maximum when used for a month, and the parameter (s) when the average whitening effect appears. = 0.1, t = -0.1, u = 0.0
The simulation image corresponding to 0) may be appropriately switched or displayed at the same time.

In addition, the present invention can take various aspects. For example, in the above-described example, an example is shown in which the L ^* a ^* b ^* color system is used for forming a simulation image of bare skin, but the present invention is not limited to this. Even when another color system is used, the simulation image of the subject's bare skin may be formed within a range that can be perceived as human skin when displayed on a monitor and within a range that can be changed with basic makeup.

[0041]

According to the present invention, the subject can grasp, as a simulation image, the impression when he or she realizes the desired bare skin. In addition, the subject, by the basic makeup,
You can know how close your skin can be to the desired skin. Therefore, it is possible to increase the motivation of the subject to improve the bare skin by the basic makeup. Also, for the subject,
It can provide basic makeup advice appropriately.

[Brief description of the drawings]

FIG. 1 is a flowchart of a method for forming a simulation image of bare skin.

FIG. 2 is a block diagram of a system for forming a simulation image of bare skin.

FIG. 3 is an explanatory diagram of a display mode of a simulation screen on a monitor screen.

FIG. 4 is an explanatory diagram of a display mode of a simulation screen on a monitor screen.

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5B050 BA06 BA12 CA06 CA07 DA04 EA13 FA02 FA03 FA05 FA19 GA08 5L096 AA02 BA08 BA18 FA15 FA46

Claims (5)

[Claims] 1. A method of forming a simulation image of a bare skin according to a desire of a subject by performing image processing on a face image of the bare skin of the subject based on a result of hearing a color of the bare skin desired by the subject, In the image processing,
Within the range that can be perceived as human skin when the simulation image is displayed on the monitor, and within the range where the color of the subject's bare skin can change with the basic makeup depending on the skin condition, the predetermined basic makeup applied to the skin A method of forming a simulation image of a bare skin, which changes a colorimetric value corresponding to a face image of the bare skin of a subject based on a database on the color or state of the bare skin before and after the basic makeup. 2. The method according to claim 1, wherein the image processing is performed on each of the pigmented area and the other area. 3. A parameter of a temporal change in a color space of a bare skin is obtained based on the database, and based on the parameter, a temporal change when a subject applies a predetermined basic makeup to the skin is calculated. 3. The method according to claim 1, wherein a plurality of simulation images are formed as shown. 4. A method of applying a basic makeup suitable for realizing a simulation image formed by the method according to any one of claims 1 to 3 on the bare skin of a subject, and applying the method to a predetermined basic makeup applied to the skin. A basic makeup advice method selected based on a database on the color or condition of the skin before and after makeup and recommended to the subject. 5. An image information acquiring means for acquiring a face image of a subject's bare skin, an arithmetic means for performing image processing on a face image of the subject's bare skin to calculate a simulated image of the subject's bare skin, and a monitor for displaying image information. In the image processing, the arithmetic means, within a range that can be perceived as human skin when a simulation image is displayed on a monitor, and within a range in which the color of the subject's bare skin can change with the basic makeup depending on the state of the skin Based on the result of hearing the color of the skin desired by the subject, based on a predetermined basic makeup applied to the skin and a database on the color or state of the bare skin before and after the basic makeup,
A simulation system of a bare skin, which changes a colorimetric value corresponding to a face image of the bare skin of the subject and calculates a simulation image of the bare skin according to the wish of the subject.