JP4832590B2 - Image analysis method, evaluation method, image analysis apparatus, and image analysis program - Google Patents

Description

  The present invention relates to an image analysis method, an evaluation method, an image analysis apparatus, and an image analysis program, and in particular, an image analysis method, an evaluation method for performing analysis of skin and the like with high accuracy using an image in the near infrared region, The present invention relates to an image analysis apparatus and an image analysis program.

  In recent years, a technique for visualizing a moisturizing liquid applied to the face surface using two near-infrared spectroscopic images using a near-infrared camera in order to visualize the moisture change of the face has been disclosed (for example, non- Patent Document 1).

  The technique shown in Non-Patent Document 1 is obtained by measuring a face using an InGaAs near-infrared camera (Sensors Unlimited, Inc. SU320M-1.7RT) having a sensitivity up to a wavelength of 900 to 1700 nm. Visualization of only the moisturizing liquid applied to the face is realized by converting to a differential absorbance image using the near-infrared spectroscopic image.

  Moreover, the method of discriminating the amount of skin moisture using near infrared is also disclosed (for example, refer patent document 1).

  The technique disclosed in Patent Document 1 includes a step of obtaining reflection intensity at a plurality of points on the skin in the near infrared wavelength range of 1050 to 1650 nm, a skin moisture content prepared in advance, and a reflection intensity in the near infrared wavelength range. Substituting the reflection intensity obtained in the above step into the prediction formula showing the relationship between the skin moisture content at a plurality of points and distinguishing the skin moisture content distribution from the obtained skin moisture content at a plurality of points. It is shown.

JP 2010-25622 A

Hiroaki Iwasaki et al., “Visualization of moisture change in face using two near-infrared spectral images”, The Optical Society of Japan (Applied Physics Society), Optics Japan 2005 Tokyo, November 23-25, 2005

  Here, in the above-described prior art, Non-Patent Document 1 shows that the wavelength at which strong absorption of water in the face is 1460 nm, while the wavelength without absorption of water is 1060 nm. Also in Patent Document 1, the wavelength range of 1050 to 1650 nm is based on the focus on the near-infrared wavelength region around the absorption wavelength of water existing in the vicinity of 1450 nm.

  However, water (OH group) has strong absorption around 1920 nm, and oil (CH group) also has absorption near 1750 nm and 2230-2400 nm. Therefore, it is preferable to perform an image of skin moisture and oil content with high accuracy using these characteristics, but such a method has not yet been disclosed. Moreover, although it is preferable to perform analysis, evaluation, skin counseling, etc. with respect to the skin by using a plurality of portions where water or oil is strongly absorbed as described above, these methods are not disclosed.

  The present invention has been made in view of the above-described problems, and is an image analysis method, an evaluation method, an image analysis apparatus, and an image for performing analysis of skin and the like with high accuracy using an image in the near infrared region. The purpose is to provide an analysis program.

  In order to solve the above-described problems, the present invention employs means for solving the problems having the following characteristics.

  The invention described in claim 1 is an image analysis method for analyzing the skin of a subject using face images of the subject photographed in a plurality of different near-infrared regions, and applying a skin external preparation to the subject An image acquisition step for acquiring the face image before and after performing, a luminance correction step for performing luminance correction on the image acquired by the image acquisition step, and an image before and after applying the skin external preparation obtained by the luminance correction step A difference amount acquisition step for acquiring the difference amount for each of the plurality of different near infrared regions, an analysis step for analyzing the skin of the subject based on the difference amount obtained by the difference amount acquisition step, and the analysis step And a screen generation step of generating a screen for displaying the obtained analysis result.

  According to the first aspect of the present invention, it is possible to analyze skin and the like with high accuracy using an image in the near infrared region. Furthermore, it is possible to evaluate the skin and the like with high accuracy from the analysis result.

  The invention described in claim 2 is that the plurality of near-infrared regions are at least two bands among 1100 to 1360 nm, 1300 to 1640 nm, 1860 to 2200 nm, 1700 to 1860 nm, and 2230 to 2400 nm. Features.

  According to the second aspect of the present invention, high-accuracy image analysis can be performed by acquiring an image in a region having high light absorption characteristics even in the near-infrared region.

  According to a third aspect of the present invention, in the screen generating step, the screen is highlighted for each predetermined pixel with a color or pattern set in advance based on the difference amount obtained in the difference amount acquiring step. Is generated.

  According to invention of Claim 3, the difference of the skin before and behind application | coating of a skin external preparation can be shown more clearly by highlighting.

  The invention described in claim 4 is characterized in that the analysis step calculates a luminance change value for a predetermined region in the screen set by the user from the screen of the analysis result obtained by the screen generation step. And

  According to invention of Claim 4, the brightness | luminance change in the position which a user desires can be acquired rapidly and with high precision.

The invention described in claim 5 is an evaluation method for analyzing the skin of a subject using a face image of the subject photographed in a plurality of different near infrared regions, and performing an evaluation using the analysis result. An image acquisition step for acquiring the face image before and after applying the skin external preparation to the subject, a luminance correction step for correcting the luminance of the image acquired by the image acquisition step, and the skin obtained by the luminance correction step The difference amount acquisition step of acquiring the difference amount between the images before and after applying the external preparation for each of the plurality of different near infrared regions, and analyzing the skin of the subject based on the difference amount obtained by the difference amount acquisition step an analysis step, a screen generation step of generating a screen displaying the analysis results obtained by the analysis step, obtained by the analysis step With analysis results, you; and a evaluation step for evaluating a state of adhesion of evaluation and / or cosmetic moisturizing effect cleanser for skin of the subject.

  According to the fifth aspect of the present invention, the skin and the like are analyzed with high accuracy using an image in the near-infrared region. Can be evaluated.

  According to a sixth aspect of the present invention, in the image analysis apparatus for analyzing the skin of a subject using face images of the subject photographed in a plurality of different near-infrared regions, a skin external preparation is applied to the subject. Image acquisition means for acquiring the face image before and after the image acquisition, luminance correction means for correcting the luminance of the image acquired by the image acquisition means, and images before and after applying the skin external preparation obtained by the luminance correction means Difference amount acquisition means for acquiring the difference amount for each of the plurality of different near infrared regions, analysis means for analyzing the skin of the subject based on the difference amount obtained by the difference amount acquisition means, and the analysis means Screen generating means for generating a screen for displaying the obtained analysis result.

  According to the sixth aspect of the invention, it is possible to analyze the skin and the like with high accuracy using an image in the near infrared region. Furthermore, it is possible to evaluate the skin and the like with high accuracy from the analysis result.

  The invention described in claim 7 is that the plurality of near-infrared regions are at least two bands among 1100 to 1360 nm, 1300 to 1640 nm, 1860 to 2200 nm, 1700 to 1860 nm, and 2230 to 2400 nm. Features.

  According to the seventh aspect of the invention, it is possible to perform highly accurate image analysis by acquiring an image in a region having a high light absorption characteristic even in the near infrared region.

  The invention described in claim 8 is a screen in which the screen generation unit highlights each predetermined pixel with a color or pattern set in advance based on the difference amount obtained by the difference amount acquisition unit. Is generated.

  According to invention of Claim 8, the difference of the skin before and behind application | coating of a skin external preparation can be shown more clearly by highlighting.

  The invention described in claim 9 is characterized in that the analysis means calculates a luminance change value for a predetermined area in the screen set by the user from the analysis result screen obtained by the screen generation means. And

  According to the ninth aspect of the present invention, it is possible to quickly and accurately acquire the luminance change at the position desired by the user.

  The invention described in claim 10 is an evaluation means for evaluating the moisturizing effect of the cleaning material on the skin of the subject and / or evaluating the adhesion state of the cosmetic based on the analysis result obtained by the analyzing means. It is characterized by having.

  According to the tenth aspect of the present invention, the skin and the like are analyzed with high accuracy using an image in the near-infrared region. Can be evaluated.

The invention described in claim 11, using the face image of the object photographed at a plurality of different near-infrared region, an image analysis program for analyzing the skin of the subject, the computer, the skin external to the subject Image acquisition means for acquiring the face image before and after applying the agent, luminance correction means for correcting the luminance of the image acquired by the image acquisition means, and before and after applying the skin external preparation obtained by the luminance correction means Difference amount acquisition means for acquiring an image difference amount for each of the plurality of different near infrared regions, analysis means for analyzing the skin of the subject based on the difference amount obtained by the difference amount acquisition means, and the analysis means Ru to function as screen generating means for generating a screen displaying the analysis results obtained by.

  According to the eleventh aspect of the present invention, skin and the like can be analyzed with high accuracy using an image in the near infrared region. Moreover, highly accurate evaluation with respect to skin etc. can be performed from the analysis result. Furthermore, by installing the program, the image analysis processing of the external preparation for skin in the present invention can be easily realized by a general-purpose personal computer or the like.

  According to the present invention, skin analysis can be performed with high accuracy using an image in the near infrared region.

It is a figure which shows an example of the absorption characteristic of the skin in a near infrared region. It is a figure which shows an example of schematic structure of the imaging | photography system in this embodiment. It is a figure for demonstrating the installation position of a filter. It is a figure which shows an example of a function structure of the image analysis apparatus in this embodiment. It is a figure which shows an example of the hardware constitutions which can implement | achieve the image analysis process in this embodiment. It is a flowchart which shows an example of the image-analysis processing procedure in this embodiment. It is a figure which shows an example of the skin image before and after application of skin lotion. It is a figure which shows the brightness | luminance change before and after the lotion application in "water 1." It is a figure which shows the brightness | luminance change before and after the lotion application in "water 2." It is a figure which shows an example of the skin image before and behind application | coating of an emulsion. It is a figure which shows the brightness | luminance change before and behind the emulsion application | coating in "water 1." It is a figure which shows the luminance change before and behind the emulsion application | coating in "oil". It is a figure which shows the brightness | luminance change before and behind the emulsion application in "water 2". It is a figure which shows an example of the hair image before and after application | coating of hair treatment. It is a figure which shows an example of the brightness | luminance change before and after the lotion application in other embodiment. It is a figure which shows an example of the selection range pseudo color display corresponding to FIG. It is a figure which shows an example of the luminance change before and behind the emulsion application | coating in other embodiment. It is a figure which shows an example of the selection range pseudo color display corresponding to FIG. It is a figure for demonstrating the application content of two products with respect to the evaluation method of Example 1. FIG. 6 is a diagram illustrating an example of an image photographed under the conditions of Embodiment 1. FIG. It is a figure which shows the evaluation result on the conditions of Example 1. FIG. FIG. 6 is a diagram illustrating an example (part 1) of an image obtained under the conditions of Example 2. FIG. 10 is a diagram illustrating an example (part 2) of an image obtained under the conditions of Example 2. FIG. 10 is a diagram illustrating an example (part 3) of an image obtained under the conditions of the second embodiment. 10 is a diagram illustrating an example of an image (No. 4) obtained under the conditions of Example 2. FIG.

<About the present invention>
The present invention uses, for example, a near-infrared camera capable of photographing in the wavelength region of 800 to 2500 nm, in addition to the absorption characteristic of water around 1460 nm, the absorption characteristic of oil around 1750 nm, and the strong absorption of water around 1920 nm. An image of a subject with respect to the characteristics and the strong absorption characteristics of a plurality of oils in the vicinity of 2230 to 2400 nm is acquired, and analysis and evaluation of skin and the like are performed on the acquired images. The near infrared light in the present invention specifically means light having a wavelength of about 800 to 2500 nm.

  Here, FIG. 1 is a diagram showing an example of skin absorption characteristics in the near-infrared region. Here, the horizontal axis of the graph shown in FIG. 1 indicates the measurement wavelength (nm), and the vertical axis indicates the absorbance (Absorbance, A / W).

  In FIG. 1, the absorption characteristic with respect to the image | photographed wavelength in water, a palmitic acid, and glycerol is each shown to Fig.1 (a)-(d). 1 (a) shows the absorption characteristics of water, FIG. 1 (b) shows the absorption characteristics of palmitic acid, FIG. 1 (c) shows the absorption characteristics of glycerin, and FIG. 1 (d). Shows the absorption characteristics of the skin.

  The characteristic range shown in FIG. 1 (i) is a near red that can be taken with a commercially available camera (for example, “ALPHA NIR camera made by FLIR SYSTEMS”, “XEVA series InGaAs near infrared camera made by XenlCs”, etc.). FIG. 1 (ii) shows a near-infrared region that can be photographed by a camera used in the present invention (for example, manufactured by Sumitomo Electric Industries, Ltd.). A camera manufactured by Sumitomo Electric Industries, Ltd. can obtain an image in the near infrared region of about 1000 to 2500 nm.

  As shown in FIG. 1, in a region photographed by a commercially available camera, there is strong water absorption around 1460 nm (region A in FIG. 1 (d)) as shown in the above-described prior art. However, since the band of the region A overlaps with the peak of the characteristics of oil (paltimic acid) and humectant (glycerin), for example, when cosmetics are applied, it is easily affected by those components, and the image in that region If only the use of is used, accurate skin analysis or the like cannot be performed.

  Here, as shown in the graph of FIG. 1 (d), it can be seen that the skin absorption characteristic has a strong absorption characteristic due to water in the vicinity of about 1920 nm in addition to the vicinity of about 1460 nm. Moreover, as shown in FIG.1 (b), in the absorption characteristic of oil, it turns out that an absorption characteristic exists in about 1700-1800 nm vicinity, and also a strong absorption characteristic exists also in about 2230-2400 nm vicinity.

  Therefore, in the present embodiment, in addition to an image near about 1460 nm with respect to water, an image of only water can be detected near about 1920 nm, so an image in the near infrared region is also acquired. In the present embodiment, near-infrared images of about 1700 to 1800 nm and about 2230 to 2400 nm are acquired for oil.

  In this way, by acquiring images of both water (OH group) and oil (CH group), and performing image analysis using one or more of the images, for example, skin external preparations such as skin lotions and emulsions. The state of the applied skin or the like is shown on the image and can be used for evaluation of uneven coating.

  Hereinafter, embodiments in which an image analysis method, an evaluation method, an image analysis apparatus, and an image analysis program according to the present invention are suitably implemented will be described with reference to the drawings.

<Photographing system: schematic configuration example>
First, a schematic configuration example of a face photographing apparatus for photographing an image acquired in the present embodiment will be described with reference to the drawings. In the following example, an example of photographing the skin of the face is shown as an example of skin. However, the present invention is not limited to this. For example, in addition to hands and arms, skin substitutes (for example, pig skin) , Artificial skin, urethane), hair, and the like for evaluating moisture and oil.

  FIG. 2 is a diagram illustrating an example of a schematic configuration of the imaging system in the present embodiment. 2 is configured to include a face photographing device 11 and an image analyzing device 12, and the face photographing device 11 and the image analyzing device 12 include a cable 13 and the like. Thus, they are connected in a state where data and control signals can be transmitted and received.

  The face photographing apparatus 11 sets the face of the subject to be analyzed, illuminates a predetermined part of the face with a predetermined light source irradiated into the sphere, and acquires the image by a camera or the like. At this time, in this embodiment, in order to acquire a face image of a subject photographed in a plurality of different near-infrared regions, filtering is performed using a preset bandpass filter to acquire image data in a predetermined near-infrared region. To do.

  In the present embodiment, when the face photographing device 11 photographs a face image of a subject, a color chart is photographed together with the face image. The color chart can be detachably attached to the face photographing apparatus 11. That is, in the present embodiment, shooting is performed so that not only the face of the subject but also the color chart appears in the shot image. As a result, image correction can be performed on the photographed image using the color chart, so that the accuracy can be improved. Note that one or a plurality of color charts can be provided, and when there are a plurality of color charts, for example, a color chart corresponding to the wavelength of the light source used at the time of photographing can be selected and used.

  Further, the face photographing apparatus 11 can reduce noise by installing a polarizing filter or the like on the camera lens to be photographed.

  Specifically, the face photographing apparatus 11 shown in FIG. 2 includes a substantially spherical dome (housing) 21, at least one light source 22, a chin rest member 23, and a camera as an imaging apparatus on a base 20. 24.

  In FIG. 2, the dome 21 has a substantially spherical shape, and the inside of the sphere is hollow. Further, the dome 21 has a shape such that the face of a person who is a subject enters, for example. In this way, by making the shape of the dome 21 spherical, the light emitted from the internal light source is diffused, and the light of the subject can be efficiently and evenly irradiated onto the face of the subject.

  The light source 22 directly irradiates the inside of the dome 21 installed on the base 20 with the light source. The number of the light sources 22 may be at least one (in the example of FIG. 1, two light sources 22-1 and 22-2 on the left and right sides of the face). Note that the installation positions of the light sources 21-1 and 22-2 differ depending on the position of the shadow of the face of the subject by irradiation, and can be adjusted as necessary.

  Further, as the light sources 22-1 and 22-2, for example, a halogen lamp can be used. For example, JD110V50W / P / M manufactured by Iwasaki Electric Co., Ltd. can be used. It is not limited to.

  For example, a halogen lamp can be used as the light source 22, but the present invention is not limited to this. For example, a temperature irradiation light source such as an incandescent bulb / halogen bulb, a high-pressure mercury lamp, a self-ballast High pressure discharge lamps (discharge light source) such as mercury lamp, metal halide lamp, high pressure sodium lamp, constant pressure discharge lamp (discharge light source) such as fluorescent lamp, low pressure sodium lamp, EL (Electroluminescence), LED (Light Emitting Diode), etc. An electroluminescent light source or the like can be used.

  As for halogen, for example, a halogen lamp, a double-ended die halogen, a PAR lamp, a dichroic mirror, or the like can be used. The fluorescent lamp can be replaced with a general illumination lamp, a reflex lamp, a krypton lamp, a mercury lamp, a ballastless mercury lamp (chalkless), a high-pressure sodium lamp, a metal halide lamp, an HQI lamp, or the like.

  In the present embodiment, it is preferable to use, for example, a halogen light source or an LED in order to photograph, for example, the near infrared region. The above two light sources can emit the same band, but there are differences depending on the properties of the materials. Specifically, the halogen light source and the LED are different in how light spreads, and the LED is more linear than the halogen light source. Also, LEDs emit less heat than halogen light sources. Therefore, in the present embodiment, which one of the halogen light source and the LED light source is used is appropriately set according to the subject to be photographed, the purpose of photographing, the photographing environment, and the like.

  The chin rest member 23 is a holding member that allows a subject to enter inside the dome 21 and hold and fix it at a predetermined position. Further, the chin rest member 23 is provided with a mechanism for adjusting the height and adjusting the left and right positions. For example, an image photographed from the camera 24 or the like is displayed on the display of the image analysis device 12, and the center of the camera 24 is It is also possible to have a scale or the like that can adjust the vertical and horizontal positions of the face. In addition, the chin rest member 23 has a configuration or a moving mechanism that can acquire a side image and a hair image in an oblique, lateral, or rearward direction instead of a front image of a subject.

  The camera 24 acquires the image of the predetermined near infrared region described above. Specifically, a near-infrared camera (for example, manufactured by Sumitomo Electric Industries, Ltd.) capable of acquiring an image in a wavelength band near about 800 to 2500 nm can be used. Further, as a lens attached to the camera 24, for example, a 25 mm lens manufactured by Fujinon Corporation can be used. In the present embodiment, a polarizing filter may be provided in order to eliminate noise such as surface reflection of a face image of a subject to be photographed and to obtain a clear image while suppressing surface glare. A specific example of the polarizing filter will be described later.

  In the present embodiment, in order to acquire an image in a predetermined near infrared region, for example, a band pass filter is installed in front of the light source or in front of the lens to acquire an image in the predetermined near infrared region. In the present embodiment, in order to capture images from a plurality of different near-infrared regions, for example, a mechanism that can be automatically switched by sliding a filter may be provided. Then, the filter may be switched. Here, FIG. 3 is a diagram for explaining the installation position of the filter.

  The band-pass filter described above includes the first filters 31-1 and 31-2 that allow light between the light sources 22-1 and 22-2 and the subject to pass through, the light reflected by the subject, and the camera (lens). A second filter 32 and a third filter 33 that allow light between them to pass therethrough. Here, for example, a UVA cut or infrared attenuation filter can be used as the first filter 31, and for example, GG395 (for example, thickness 3 mm, 100 × 100 mm) manufactured by SCHOTT can be used.

  Furthermore, the second filter 32 is an ND filter that is used, for example, in combination with a band-pass filter (third filter 33) described later. The ND filter is a filter for adjusting the amount of light entering the lens, and is for adjusting the amount of light that varies depending on the type of bandpass filter.

  In this embodiment, images of a predetermined near-infrared region are acquired using a plurality of bandpass filters. However, since the amount of transmitted light varies depending on the wavelength, measurement can be performed without changing camera settings as much as possible. Is preferred. Therefore, by preparing a plurality of the above-described ND filters corresponding to a plurality of bandpass filters and switching them as appropriate, the amount of light can be attenuated and the amount of light can be adjusted. As the ND filter, for example, NG5 manufactured by SCHOTT (for example, a circle having a diameter of 25.4 mm, a thickness of 1 mm) or the like can be used.

  Here, for example, a filter manufactured by Spectrogon can be used as the third filter 37 for acquiring an image in a predetermined near-infrared band using a plurality of bandpass filters. In addition, for example, when acquiring a base image, the region of the third filter 37 can acquire an image obtained from a band of about 1100 to 1360 nm, for example, and the center wavelength is about 1300 nm ± 40 nm. Get a degree image.

  Further, when acquiring an image with strong water absorption characteristics, for example, when acquiring an image for the region A in FIG. 1D, an image obtained from a band of about 1300 to 1640 nm is acquired. Preferably, an image having a center wavelength of about 1460 nm ± 45 nm is acquired. Similarly, when acquiring an image with higher sensitivity and water absorption characteristics, for example, when acquiring an image for the region B in FIG. 1D, the image is obtained from a band of about 1860 to 2200 nm, for example. An image with a center wavelength of about 1920 nm ± 55 nm or so and about 1950 nm ± 56 nm is preferably obtained.

  In addition, when acquiring an image having a strong oil absorption characteristic as shown in the region C in FIG. 1B, an image obtained from a band of about 1700 to 1860 nm can be acquired. An image of about 1775 nm ± 50 nm or 1755 nm ± 20 nm is acquired. Furthermore, when acquiring an image having a strong oil absorption characteristic as shown in the region D in FIG. 1B, an image obtained from a band of about 2230 to 2400 nm, for example, can be acquired. An image having a wavelength of about 2345 nm ± 50 nm is acquired. Since there are a plurality of peaks in the region D, an image using one of the wavelengths may be acquired, or an image may be acquired from a plurality of wavelengths that are peaks. Further, in the band of about 2230 to 2400 nm, the difference in water absorption characteristics is large as shown in FIG. 1A. Therefore, in this embodiment, the band is appropriately set according to the conditions (drying, humidity, etc.) of the object to be imaged. Can be set.

  In addition, the filter used in order to acquire the image of these near-infrared bands may be implement | achieved in one filter, and may combine several filters.

  Furthermore, in this embodiment, for example, the color chart may be installed on the chin rest member 23 shown in FIG. As a result, the face image of the subject and the color chart can be included in the image photographed by the camera 24, and the accuracy can be improved by performing correction between the plurality of images using the color chart. A specific example of the color chart will be described later.

  The face image of the subject photographed from the camera 24 using the illumination device 11 having the above-described configuration or the like is output to the image analysis device 12 via the cable 13 shown in FIG. Note that the communication between the face photographing apparatus 11 and the image analysis apparatus 12 may be wireless communication using infrared rays or the like, or may be wired communication via a LAN cable or the like. Furthermore, the captured image may be transmitted to the image analysis device 12 at a remote location using a communication network such as the Internet.

  Here, the image photographed in the present embodiment is, for example, an image after applying a skin external preparation such as skin lotion or emulsion on a subject, immediately after application, after application, and after a predetermined time has elapsed after application. .

  In the present embodiment, the image photographed by the face photographing apparatus 11 may be an image photographed by a user instruction or a real-time video photographed continuously. Further, the image photographed by the face photographing device 11 is on the skin (cheek, forehead, etc.) of the subject included in the face, eyelids, eyes, under the eyes, around the eyes, nose, mouth, mouth, ears, eyebrows, jaws, etc. It is not limited, For example, a neck, hair, etc. are included, Furthermore, an arm, a hand, a leg, etc. are also included. Therefore, the contents analyzed by the image analysis device 12 can correspond to all the images obtained by the face photographing device 11 described above.

  The image analysis device 12 acquires a plurality of predetermined near-infrared region images photographed by the face photographing device 11, and performs analysis / evaluation of an image related to water and oil on the skin of the subject based on the obtained images. This makes it possible to visualize and output the state of the skin when applying a skin external preparation such as skin lotion or moisturizer, and the unevenness in the image, thereby performing highly accurate analysis and evaluation, or displaying the result. be able to. Note that the image analysis apparatus 12 can realize the analysis processing in the present embodiment using a general-purpose personal computer or the like.

  Here, as the skin external preparation in the present invention, for example, an aqueous solution system, a solubilization system, an emulsification system, a powder dispersion system, a water-oil two-layer system, a water-oil-powder three-layer system, etc. It can be applied to not only lotions and emulsions, but also basic cosmetics such as creams and packs, makeup cosmetics such as lipsticks and foundations, hair products such as shampoos, rinses and hair dyes. It covers a wide range of fields such as special cosmetics such as sunscreen.

<About polarizing filter>
Next, a specific example of the polarizing filter in the present embodiment described above will be described. In general, when an image is captured, reflected light (such as glare) unnecessary for analysis on the surface of the observation target due to the light source may occur. Further, unnecessary reflected light affects the luminance value of the acquired image, which may cause an error when performing quantitative evaluation by image analysis.

  Therefore, in the present embodiment, a polarizing filter is installed at the front part, rear part, or both of the lens of the camera 24. In the present embodiment, a polarizing filter may be provided not at the vicinity of the lens but at the front of the light source. Furthermore, in this embodiment, a polarizing filter is installed in both the lens and the light source. One or more polarizing filters can be installed.

  Thereby, in this embodiment, the reflected light unnecessary for the analysis which arises on the observation target object surface can be removed. Moreover, in this embodiment, noise can be reduced by installing these filters, and highly accurate analysis can be performed.

<About color chart>
Next, a specific example of the color chart in the above-described embodiment will be described. Usually, when comparing between images using quantitative evaluation by image analysis, it is an analysis problem that a slight difference is caused depending on photographing conditions. Therefore, in this embodiment, by correcting the luminance value of the acquired image using an arbitrary color chart that can specify the reflectance of white to black, it becomes possible to compare images regardless of the timing of image acquisition. Can be analyzed with high accuracy.

  For example, a plurality of color charts having different reflectivities are arranged in parallel on the board, and the color chart can be selected according to the wavelength of the light source used when photographing the subject. By using the color chart in this way, it is possible to correct the luminance between captured images.

<Image Analysis Device 12: Functional Configuration Example>
Next, a functional configuration example of the image analysis device 12 in the present embodiment will be described with reference to the drawings. FIG. 4 is a diagram illustrating an example of a functional configuration of the image analysis apparatus according to the present embodiment. 4 includes an input unit 41, an output unit 42, a storage unit 43, a captured image acquisition unit 44, an image analysis unit 45, an evaluation unit 46, an image generation unit 47, and a control. And means 48.

  The input unit 41 receives input from the user or the like such as start / end of various instructions such as an image acquisition instruction, an image analysis instruction, and an evaluation instruction. Note that the input unit 41 includes, for example, a keyboard and a pointing device such as a mouse. The input unit 11 also has a function of inputting an image including an imaging part of a subject photographed by an imaging unit such as a digital camera.

  The output unit 42 displays / outputs the content input by the input unit 41 and the content executed based on the input content. Note that the output means 42 includes a display, a speaker, and the like. Further, the output unit 42 may have a function of a printer or the like. In that case, the image analysis result or the like can be printed on a printing medium such as paper and provided to a user or a subject.

  The input means 41 and the output means 42 may be integrated input / output means such as a touch panel, for example. In this case, the input means 41 and the output means 42 may be predetermined using a user's finger or a pen-type input device. Input can be made by touching the position.

  Further, the storage unit 43 stores various data such as each image information based on the captured image obtained by the captured image acquisition unit 44, the image analysis result by the image analysis unit 45, the evaluation result generated by the image generation unit 47, and the like. In addition, the storage unit 43 can read out various data stored as necessary.

  The captured image acquisition unit 44 acquires a face image of the subject captured by the camera 24 in the face photographing apparatus 11. The photographed image acquisition unit 44 can set, for example, the type, position, number, and the like of the light source to be used according to the contents of the photographed image when the face photographing apparatus 11 photographs the face of the subject. Furthermore, the photographed image acquisition means 44 uses the first to third filters 31 to 33 described above in combination with the camera 24 of the face photographing device 11, so that a predetermined bandpass filter is used. In order to acquire an image in the near infrared region, instruction information indicating the photographing condition is generated and output to the face photographing apparatus 11. The image acquired by the captured image acquisition unit 44 is stored in the storage unit 43.

  The image analysis unit 45 performs luminance correction and calculation of an average luminance value on the image obtained by the captured image acquisition unit 44, analysis of luminance change before and after application of a skin external preparation such as skin lotion and emulsion, and luminance change value. Analysis of calculation, setting of pseudo color corresponding to the luminance difference for the region selected by the user, and the like is performed. The image analysis means 45 can analyze the skin from these images using the images before application, immediately after application, and after application, and evaluate the results. Further, the image analysis means 45 may be performed on the entire skin of the face where the image analysis portion is photographed, and image analysis is performed only on an area designated by the user or the like using the input means 41 or the like. You may go. The designated area may be one or plural.

  Furthermore, in the present embodiment, the image analyzed by the image analysis unit 45 may be analyzed in real time each time being captured from the face photographing device 11, or analyzed using an image stored in the storage unit 43 in advance. May be.

  Further, the image analyzed by the image analysis means 45 is, for example, a skin image such as a cheek or forehead, and skin image analysis can also be performed on images such as arms, hands, and feet. Furthermore, the image analysis means 45 can also analyze hair. A specific example of processing in the image analysis unit 45 will be described later.

  The evaluation unit 46 evaluates the skin, skin, and the like of the user (subject) who has taken the image based on the image analysis result obtained by the image analysis unit 45.

  Note that the evaluation unit 46 evaluates the effect of the cosmetic (external preparation for skin) based on the image analysis result obtained by the image analysis unit 45, for example, considering an image portion having a large amount of moisture as skin. Specifically, the evaluation means 46 can identify the exposed part of the skin from the moisture distribution state analysis using the near-infrared image. It is possible to evaluate the effect, and it is possible to evaluate the change in the adhesion state of the makeup cosmetic applied to the skin such as foundation (FD).

  Further, according to the present embodiment, as described above, for example, an image having a center wavelength of about 2345 nm ± 50 nm can be acquired in a band of about 2230 to 2400 nm in the near-infrared region. A strong image can be acquired. Therefore, the evaluation means 46 can obtain the analysis result of the obtained image by the image analysis means 45, thereby enabling evaluation of the skin quality by moisture using the distribution state of the moisture image in the skin of an arbitrary part, In addition, it is possible to evaluate the skin quality by oil using the distribution state of the oil image on the skin of an arbitrary site.

  Moreover, according to this embodiment, the evaluation means 46 can evaluate the moisturizing effect by the cleaning material by analyzing the moisture image of the skin cleaning site before and after using the cleaning material.

  The evaluation means 46 can perform any one or more of the above-described evaluation methods. Further, when a plurality of evaluations are performed, the evaluation unit 46 may set the evaluation order in advance, and may select the order according to the photographing target.

  The image generation unit 47 generates an image to be presented to the user based on the result analyzed by the image analysis unit 45 or the result evaluated by the evaluation unit 46. Specifically, the image generation unit 47 combines pseudo colors corresponding to the luminance differences analyzed by the image analysis unit 45, and displays the combined image on the screen.

  Note that the image generation unit 47 performs processing such as enlargement of a luminance region for a predetermined region, calculation of a difference image, luminance reversal, etc., in order to display the composite image on the screen so that it can be easily seen by the user. It can also be displayed.

  Further, the image generation unit 47 performs processing such as pseudo color generation for an area set by the user in the image. Note that specific processing in the image generation unit 47 will be described later.

  The control unit 48 controls the entire components of the image analysis device 12. Specifically, the control unit 48 performs various controls such as image analysis processing and image generation processing based on, for example, an instruction from the input unit 41 by a user or the like.

<Image Analysis Device 12: Hardware Configuration>
Here, in the image analysis apparatus 12 described above, an execution program (image analysis program) that can cause a computer to execute each function is generated, and the execution program is installed in, for example, a general-purpose personal computer or server. Analysis can be performed using images in a predetermined near-infrared region taken before and after application of the external preparation for skin in the present invention and after a predetermined time has elapsed after application.

  Here, a hardware configuration example of a computer capable of realizing the image analysis processing according to the present embodiment will be described with reference to the drawings.

  FIG. 5 is a diagram illustrating an example of a hardware configuration capable of realizing the image analysis processing according to the present embodiment. 5 includes an input device 51, an output device 52, a drive device 53, an auxiliary storage device 54, a memory device 55, a CPU (Central Processing Unit) 56 for performing various controls, and a network connection device. 57 are connected to each other by a system bus B.

  The input device 51 has a pointing device such as a keyboard and a mouse operated by a user or the like, and inputs various operation signals such as execution of a program from the user or the like. In addition, the input device 51 is configured to capture an object photographed after application of an external preparation for skin or after exposure to near infrared rays in an already measured evaluation target site obtained from an external device connected to the network connection device 57 or the like via a communication network. Various data such as a face image can also be input.

  The output device 52 has a display for displaying various windows and data necessary for operating the computer main body for performing processing according to the present invention, and displays the program execution progress, results, and the like by the control program of the CPU 56. can do. Further, the output device 52 can print the above processing result or the like on a print medium such as paper and present it to the user or the like.

  Here, the execution program installed in the computer main body in the present invention is provided by, for example, a portable recording medium 58 such as a USB (Universal Serial Bus) memory, a CD-ROM, or a DVD. The recording medium 58 on which the program is recorded can be set in the drive device 53, and the execution program included in the recording medium 58 is installed in the auxiliary storage device 54 from the recording medium 58 via the drive device 53.

  The auxiliary storage device 54 is a storage means such as a hard disk, and can store an execution program according to the present invention, a control program provided in a computer, etc., and perform input / output as necessary.

  The memory device 55 stores an execution program or the like read from the auxiliary storage device 54 by the CPU 56. The memory device 55 includes a ROM (Read Only Memory), a RAM (Random Access Memory), and the like.

  The CPU 56 controls processing of the entire computer, such as various operations and input / output of data with each hardware component, based on a control program such as an OS (Operating System) and an execution program stored in the memory device 55. Thus, each processing can be realized. Various information necessary during the execution of the program can be acquired from the auxiliary storage device 54, and the execution result and the like can also be stored.

  The network connection device 57 obtains an execution program from another terminal connected to the communication network by connecting to a communication network or the like, or an execution result obtained by executing the program or an execution in the present invention The program itself can be provided to other terminals.

  Further, the network connection device 57 acquires various data such as a skin image of a subject photographed after application of an external skin preparation or after exposure to ultraviolet rays at an evaluation target site that has already been measured by an external device connected to a communication network. You can also.

  With the hardware configuration as described above, the image analysis processing in the present invention can be executed. Further, by installing the program, the image analysis processing according to the present invention can be easily realized by a general-purpose personal computer or the like.

<Image analysis processing procedure>
Next, an image analysis processing procedure in the present embodiment using the image analysis device 12 and the image analysis program described above will be described. FIG. 6 is a flowchart illustrating an example of an image analysis processing procedure in the present embodiment.

  In the image analysis processing shown in FIG. 6, first, a face image of a subject before application of a skin external preparation, which is a base, is acquired (S01), and further, a face image of the subject after application of a skin external preparation is acquired (S02). The images acquired in the processes of S01 and S02 are images of subjects in a predetermined near-infrared region filtered by the above-described filter or the like using a light source such as a halogen lamp in the above-described face photographing device 11 or the like. get.

  In the process of S01, a base image may be acquired in advance and stored in a storage unit or the like.

  In addition, after applying the external preparation for skin, it is preferable that a predetermined time elapses to such an extent that the effect is seen. The elapsed time varies depending on the external preparation for skin, the amount applied, the site applied, and the like. Therefore, the image acquired in the process of S02 may be, for example, an image immediately after application of the external preparation for skin, and further, an image after a predetermined time has elapsed since application (for example, after 10 minutes or 30 minutes). May be acquired continuously. Further, a plurality of these images may be acquired over time at predetermined time intervals. Further, the image acquired in the process of S02 is analyzed and evaluated in comparison with the image of S01 in the subsequent stage.

  Next, luminance correction is performed on the images obtained in S01 and S02 (S03), and a difference image between the two images is generated using the luminance corrected images (S04). Note that the processing of S03 and S04 may be performed on the entire acquired image set in advance, or may be performed on an area (one or more) in the image set in advance by the user or the like.

  Next, in the process of S04, a pseudo color preset according to the magnitude of the luminance difference value is assigned to the obtained difference image for each predetermined pixel in the region (S05), and the assigned pseudo image is further assigned. The color is combined with the difference image to generate an evaluation screen or the like (S06), and the generated image is displayed on the screen (S07). In the process of S06, an evaluation screen or the like is generated using the analysis result obtained from the image analysis unit 45 described above, the evaluation result obtained from the evaluation unit 46, or the like.

  Here, it is determined whether or not to perform analysis using another image (S08). When analysis using another image is performed (YES in S08), the process returns to S03 and uses the other image acquired in the process of S02. Then, the processing described later is performed to analyze and evaluate the image.

  Here, when the image is analyzed, the evaluation may be performed using a preset pseudo color as an index as described above. It should be noted that the index may be derived in advance by using an index that is set in advance, or may be arbitrarily set based on the evaluation target site, the component of the external preparation for skin, the content of the index that has already been derived and evaluated, and the like. Thereby, skin conditions, such as the nonuniformity after apply | coating a skin external preparation to a user, can be evaluated simply and for a short time.

<Example of image analysis>
Next, an example of image analysis in the present embodiment will be specifically described. In this example, “(1) Moist lotion applied to the left cheek with cotton and analyzed before and immediately after application” and “(2) Moist latex applied to the left cheek with cotton, An example of “analysis before application, immediately after application, and 10 minutes after application” and “(3) an example in which a hair treatment for laying on the left hair is sprayed and analyzed before and immediately after application” will be described.
<(1) Before and after applying lotion>
FIG. 7 is a diagram showing an example of a skin image before and after applying lotion. In the example shown in FIG. 7, images of “base”, “water 1”, and “water 2” before and immediately after application are shown. Here, “base” indicates an image acquired with a center wavelength of about 1300 nm ± 40 nm, “water 1” indicates an image acquired with a center wavelength of about 1500 nm ± 45 nm, and “water 2” indicates a center wavelength. Is an image acquired at about 1920 nm ± 55 nm. Moreover, the area | regions 61-1 to 61-3 immediately after application | coating shown in FIG. 7 have shown the part which apply | coated the skin external preparation (skin lotion in the example of FIG. 7).

  In addition, all the images shown in FIG. 7 are subjected to luminance correction in the present embodiment. Luminance correction is, for example, calculating an average value in a predetermined pixel unit (for example, 20 × 20 pixels) in an image, and setting the image to black with a luminance of 30 and gray with a luminance of 120 at two points. Correct the whole. Thereby, the noise on an image can be reduced and an image can be smoothed.

  According to FIG. 7, when there is water, it is displayed in black, and particularly in the near-infrared region of “water 2” in the present embodiment, that portion is black in the applied region 61-3. Recognize.

<Example of analysis>
Next, a specific analysis example in the present embodiment when a skin external preparation (skin lotion, emulsion) is applied will be described with reference to the drawings.

<Coating lotion: Example 1>
FIG. 8 is a diagram showing a luminance change before and after application of the skin lotion in “water 1”. In the example shown in FIG. 8, an example in which the difference from the base image before and immediately after application is imaged and an example in which the difference is displayed in pseudo color within the selection range are shown. Further, in the example of FIG. 8, in order to correct the reflection on the skin surface to some extent, after the luminance correction, a difference image obtained by subtracting the base image from the “water 1” image was calculated. In this image, the portion where water is applied is displayed in white.

  In the example of FIG. 8, lotion is applied to the application region 62 and the user selects the predetermined selection range 63 by dragging or the like using the input means 41 such as a mouse, and an image is displayed within the selection range. The pseudo color is set by the analyzing unit 45 and the result is displayed by the image generating unit 47.

  In the present embodiment, the pseudo color represents a preset color or pattern according to the luminance difference. That is, pseudo color display is performed according to the magnitude of the changed luminance, and the face image is synthesized and superimposed. Therefore, it is possible to accurately grasp where the difference is.

  In the example of FIG. 8, when the pseudo color display in the selection range 63-1 before coating is compared with the pseudo color display in the selection range 63-2 immediately after coating, the selection range 63-2 just after coating has a higher luminance. It shows that the amount of change is large. The image analysis in the image analysis unit 45 may be performed by assigning a pseudo color of a predetermined color corresponding to the luminance change value in a preset pixel unit (for example, square pixels such as 1 × 1, 2 × 2, etc.). Good.

  Further, in the example of FIG. 8, the luminance change value is acquired by the image analysis unit 45. In the example of FIG. 8, one or a plurality of luminance change value measurement areas (in the example of FIG. 8, luminance change value measurement areas 64-1 and 64-2) set by the user using the input unit 41 or the like are set. For the set area, for example, a luminance change value composed of “average luminance ± standard deviation” is displayed.

  In the example of FIG. 8, the luminance change value of the luminance change value measurement region 64-1 is 93.1 ± 6.1, and the luminance change value of the luminance change value measurement region 64-2 is 71.0 ± 5. It turns out that it is 7.

<Lotion application: Example 2>
FIG. 9 is a diagram showing a luminance change before and after application of the skin lotion in “water 2”. In the example shown in FIG. 9, as in FIG. 8, an example in which the difference from the base image before and immediately after application is imaged and an example in which the difference is displayed in pseudo color within the selection range are shown. Further, in the example of FIG. 9, in order to correct the reflection on the skin surface to some extent, after performing luminance correction, a difference image obtained by subtracting the base image from the “water 2” image was calculated. In this image, the portion where water is applied is displayed in white.

  In the example of FIG. 9, lotion is applied to the application region 62 and the user selects the predetermined selection range 63 by dragging or the like using the input means 41 such as a mouse, and an image is displayed in the selection range. The pseudo color is set by the analyzing unit 45 and the result is displayed by the image generating unit 47.

  In the example of FIG. 9, when the pseudo color display in the selection range 63-1 before coating is compared with the pseudo color display in the selection range 63-2 immediately after coating, the selection range 63-2 just after coating has a higher luminance. It is shown that the amount of change is particularly large.

  Further, in the example of FIG. 9, the luminance change values (in the example of FIG. 9, the luminance change value measurement areas 64-1 and 64-2) are set by the image analysis unit 45, and for example, “ A luminance change value consisting of “average luminance ± standard deviation” is displayed. In the example of FIG. 9, the luminance change value of the luminance change value measurement region 64-1 is 195.4 ± 7.9, and the luminance change value of the luminance change value measurement region 64-2 is 153.6 ± 6. It turns out that it is zero. That is, it can be seen that “water 2” has a larger luminance difference from the base image than “water 1”.

In the above description, the change in the brightness of the water in the selected region before and after the application of the skin lotion was calculated after some processing. Further, pseudo color display is performed according to the magnitude of the changed luminance, and the image is superimposed on the face image. In the lotion application portion, the luminance values of “water 1” and “water 2” changed greatly. “Water 1” and “Water 2” had slightly different change patterns. This is considered to be due to the fact that the detection sensitivity of water by the wavelength or the depth in the skin detected by the wavelength of water varies. (Reference paper: M Egawa, H Arimoto, T Hirao, M Takahashi, and Y Ozaki, Regional Difference of Water Content in Human Skin Studied by Diffuse-reflectance Near-infrared Spectroscopy-Consideration of Measurement Depth-, Appl Spectrosc, 60 (1 ), 24-28 (2006).
<(2) Before and after application of emulsion>
Next, skin images before and after application of the emulsion will be described with reference to the drawings. FIG. 10 is a diagram illustrating an example of a skin image before and after application of the emulsion. In the example shown in FIG. 10, images of “base”, “water 1”, “oil”, and “water 2” before and after application and after 10 minutes have elapsed are shown.

  Here, “base” indicates an image acquired at a center wavelength of about 1300 nm ± 40 nm, “water 1” indicates an image acquired at a center wavelength of about 1500 nm ± 45 nm, and “oil” indicates 1775 nm ± 50 nm. The image acquired with the degree is “water 2”, and the image obtained with the center wavelength of about 1920 nm ± 55 nm is shown. Moreover, the area | regions 61-1 to 61-4 immediately after application | coating shown in FIG. 10 have shown the part which apply | coated the skin external preparation (in the example of FIG. 10, emulsion). Further, in FIG. 10, the above-described luminance correction is performed on all the acquired drawings.

  As shown in FIG. 10, areas 62-1 to 62-4 of the acquired image indicate application areas in “base”, “water 1”, “oil”, and “water 2”, respectively. As shown in the regions 62-1 to 62-4, when there is water or oil, it becomes black. In the example of FIG. 10, since it is a milky lotion, both water and oil are changing. It can be seen that the degree of blackness is reduced after 10 minutes compared to immediately after application.

  The acquisition of the image of the oil is not limited to the above-described center wavelength. For example, a similar image is acquired even when using a band of about 2230 to 2400 nm (preferably a band having a center wavelength of about 2345 nm ± 50 nm). can do. The same applies to the following description.

<Emulsion: Example 1>
Next, examples of the emulsion will be described. FIG. 11 is a diagram showing a luminance change before and after the emulsion application in “water 1”. The example shown in FIG. 11 shows an example in which the difference from the base image before application, immediately after application, and after 10 minutes is imaged, and an example in which the difference is displayed in pseudo color within the selection range. Further, in the example of FIG. 11, in order to correct the reflection on the skin surface to some extent, after the luminance correction, a difference image obtained by subtracting the base image from the “water 1” image was calculated. In this image, the portion where water is applied is displayed in white.

  In the example of FIG. 11, lotion is applied to the application region 62 and the user selects the predetermined selection range 63 by dragging or the like using the input means 41 such as a mouse, and an image is displayed in the selection range. The pseudo color is set by the analyzing unit 45 and the result is displayed by the image generating unit 47.

  In the present embodiment, the pseudo color represents a preset color or pattern according to the luminance difference. That is, pseudo color display is performed according to the magnitude of the changed luminance, and the face image is synthesized and superimposed. Therefore, it is possible to accurately grasp where the difference is.

  In the example of FIG. 11, when the pseudo color display in the selection range 63-1 before coating is compared with the pseudo color display in the selection range 63-2 immediately after coating, the selection range 63-2 just after coating has a higher luminance. It shows that the amount of change is large. Further, when comparing the pseudo color display in the selection range 63-2 immediately after application with the pseudo color display in the selection range 63-3 after 10 minutes of application, the selection range 63-3 after 10 minutes of application has a higher luminance. It is shown that the amount of change is decreasing.

  That is, according to FIG. 11, in order to correct the reflection on the skin surface to some extent, after correcting the luminance, a difference image obtained by subtracting the base image from the water or oil image is calculated. The part to which is applied is displayed in white. Moreover, because of the emulsion, “water 1” is kept even after 10 minutes. In other words, it can be seen that it remains on the skin.

  Further, when the luminance change of “water 1” in the selected region before and after application of the lotion is calculated after performing several processes in the same manner as in the above-described example of the lotion, the luminance change value measurement region 64 immediately after application is calculated. The luminance change value of −1 is 119.0 ± 10.5, and the luminance change value of the luminance change value measurement region 64-2 is 72.7 ± 4.9. Further, the luminance change value of the luminance change value measurement region 64-3 after 10 minutes of application is 103.6 ± 8.0, and the luminance change value of the luminance change value measurement region 64-4 is 75.2 ± 4. .5.

<Emulsion: Example 2>
Next, examples of the emulsion will be described. FIG. 12 is a diagram showing a luminance change before and after applying the emulsion in “oil”. The example shown in FIG. 12 shows an example in which the difference from the base image before application, immediately after application, and after 10 minutes is imaged, and an example in which the difference is displayed in pseudo color within the selection range. Further, in the example of FIG. 12, in order to correct the reflection on the skin surface to some extent, after performing luminance correction, a difference image obtained by subtracting the base image from the “oil” image is calculated. In this image, the oil-applied portion is displayed in white.

  In the example of FIG. 12, lotion is applied to the application region 62 and the user selects the predetermined selection range 63 by dragging or the like using the input means 41 such as a mouse, and an image is displayed in the selection range. The pseudo color is set by the analyzing unit 45 and the result is displayed by the image generating unit 47.

  In the present embodiment, the pseudo color represents a preset color or pattern according to the luminance difference. That is, pseudo color display is performed according to the magnitude of the changed luminance, and the face image is synthesized and superimposed. Therefore, it is possible to accurately grasp where the difference is.

  In the example of FIG. 12, when the pseudo color display in the selection range 63-1 before coating is compared with the pseudo color display in the selection range 63-2 immediately after coating, the selection range 63-2 just after coating has a higher luminance. It shows that the amount of change is large. Further, when comparing the pseudo color display in the selection range 63-2 immediately after application with the pseudo color display in the selection range 63-3 after 10 minutes of application, the selection range 63-3 after 10 minutes of application has a higher luminance. It is shown that the amount of change is decreasing.

  That is, according to FIG. 12, in order to correct the reflection on the skin surface to some extent, after correcting the luminance, a difference image obtained by subtracting the base image from the water or oil image is calculated. The part to which is applied is displayed in white. Also, because of the emulsion, the “oil” is kept even after 10 minutes. In other words, it can be seen that it remains on the skin.

  In addition, when the luminance change of the “oil” in the selected region before and after the application of the lotion is calculated after performing several processes in the same manner as in the above-described example of the lotion, the luminance change value measurement region 64- The luminance change value of 1 is 146.8 ± 10.4, and the luminance change value of the luminance change value measurement region 64-2 is 109.9 ± 5.8. In addition, the luminance change value of the luminance change value measurement region 64-3 10 minutes after application is 132.5 ± 5.8, and the luminance change value of the luminance change value measurement region 64-4 is 103.2 ± 5. It turns out that it is 0.0.

<Emulsion: Example 3>
Next, examples of the emulsion will be described. FIG. 13 is a diagram showing a luminance change before and after the emulsion application in “water 2”. The example shown in FIG. 13 shows an example in which the difference from the base image before application, immediately after application, and after 10 minutes is imaged, and an example in which the difference is displayed in pseudo color within the selection range. Further, in the example of FIG. 13, in order to correct the reflection on the skin surface to some extent, after the luminance correction, a difference image obtained by subtracting the base image from the “water 2” image was calculated. In this image, the portion where water is applied is displayed in white.

  In the example of FIG. 13, lotion is applied to the application region 62 and the user selects the predetermined selection range 63 by dragging or the like using the input means 41 such as a mouse, and an image is displayed in the selection range. The pseudo color is set by the analyzing unit 45 and the result is displayed by the image generating unit 47.

  In the present embodiment, the pseudo color represents a preset color or pattern according to the luminance difference. That is, pseudo color display is performed according to the magnitude of the changed luminance, and the face image is synthesized and superimposed. Therefore, it is possible to accurately grasp where the difference is.

  In the example of FIG. 13, when the pseudo color display in the selection range 63-1 before application is compared with the pseudo color display in the selection range 63-2 immediately after application, the selection range 63-2 immediately after application has a brightness higher than that of the selection range 63-2. It shows that the amount of change is large. Further, when comparing the pseudo color display in the selection range 63-2 immediately after application with the pseudo color display in the selection range 63-3 after 10 minutes of application, the selection range 63-3 after 10 minutes of application has a higher luminance. It is shown that the amount of change is decreasing.

  That is, according to FIG. 13, in order to correct the reflection on the skin surface to some extent, after correcting the luminance, a difference image obtained by subtracting the base image from the water or oil image is calculated. The part to which is applied is displayed in white. Moreover, because of the emulsion, “water 2” is maintained even after 10 minutes. In other words, it can be seen that it remains on the skin.

  Further, when the luminance change of “water 2” in the selected region before and after the application of the lotion is calculated after performing some processes in the same manner as in the above-described example of the lotion, the luminance change value measurement region 64 immediately after application is calculated. The luminance change value of −1 is 194.3 ± 14.8, and the luminance change value of the luminance change value measurement region 64-2 is 139.0 ± 4.9. In addition, the luminance change value of the luminance change value measurement region 64-3 10 minutes after application is 184.5 ± 10.6, and the luminance change value of the luminance change value measurement region 64-4 is 139.2 ± 5. It turns out that it is 0.0.

  Immediately after application, portions where “oil”, “water 1”, and “water 2” are applied are changed. Further, the change was “water 2”> “water 1”, but this factor may be imaging sensitivity and imaging depth, as described above. In addition, after 10 minutes of application, “water 1”, “water 2”, and “oil” are all decreased from immediately after, but it is understood that they still exist sufficiently.

  In addition, when looking at areas other than the application site, “oil” has almost no change, whereas “water 2” has 10 minutes more water than before application when the brightness value changes. Yes. The application was performed 10 minutes after the face washes, but there was a possibility that the process of recovering the amount of water lost by the face was recovered by the function of the skin originally possessed.

  As described above, when images are combined in a plurality of near infrared regions, simultaneous analysis can be performed on a sample that wants to follow changes in both water and oil, such as an emulsion.

<(3) Before and after application of hair treatment>
Next, skin images before and after application of hair treatment will be described with reference to the drawings. FIG. 14 is a diagram illustrating an example of a hair image before and after application of a hair treatment. In the example of FIG. 14, images of “base”, “water 1”, and “water 2” before and immediately after application are shown.

  Here, “base” indicates an image acquired with a center wavelength of about 1300 nm ± 40 nm, “water 1” indicates an image acquired with a center wavelength of about 1500 nm ± 45 nm, and “water 2” indicates a center wavelength. Is an image acquired at about 1920 nm ± 55 nm. Moreover, the area | regions 61-1 to 61-3 immediately after application | coating shown in FIG. 14 have shown the part which apply | coated the skin external preparation (the hair treatment in the example of FIG. 14). Further, in FIG. 14, the above-described luminance correction is performed on all the acquired drawings.

  As illustrated in FIG. 14, areas 62-1 to 62-3 of the acquired image indicate application areas in “base”, “water 1”, and “water 2”, respectively. It turns black when there is water as shown in ~ 62-3.

  That is, in FIG. 14, the face photographing device 11 described above was photographed with the back of the head. In the example of FIG. 14, it becomes black when there is water. Here, unlike the skin, hair originally appears white because of its very low water content. The reason why there is a black part immediately after the application of the base image is that when the water-based treatment is sprayed, the sprayed part becomes a bundle, and the hair is bundled and floats.

  In the “water 1” and “water 2” images shown in FIG. 14, the sprayed portion appears black due to water absorption. Although “Water 1” and “Water 2” are captured differently, it is thought that there is a difference in water detection sensitivity or imaging depth depending on the wavelength.

<Second Embodiment>
Next, a second embodiment will be described. In the second embodiment, the contents presented in the above-described embodiments are shown in a more easily understandable manner for the user to display a screen presented to the user.

  Here, FIG. 15 is a figure which shows an example of the brightness | luminance change before and after the lotion application in other embodiment. FIG. 16 is a diagram showing an example of the selection range pseudo color display corresponding to FIG.

  FIGS. 15 and 16 show changes (“Water 1”-“Base”), (“Oil”-“Base”), (“Water 2”-“Base”) immediately after application, before application. ing. In addition, the lotion is shown in the application area 71 of the external preparation for skin. Also, the color of the difference image of the luminance change is shown differently for “water 1” and “water 2” and for “oil”. FIG. 15 shows that in the application area 71, the color is displayed darkly and the difference value is large.

  FIG. 16 shows the selection range 72 to which the above-described pseudo color is assigned and the luminance change value measurement areas 73-1 to 73-3 under each condition. In the case of “water 1” − “base” in the change from before application immediately after application, the luminance change value of the luminance change value measurement region 73-1 is 185.6 ± 22.7, and the luminance change value measurement region It can be seen that the luminance change value of 73-2 is 205.7 ± 17.9, and the luminance change value of the luminance change value measurement region 73-3 is 238.7 ± 16.0. In the case of “oil”-“base”, the luminance change value of the luminance change value measurement region 73-1 is 213.7 ± 22.4, and the luminance change value of the luminance change value measurement region 73-2 is It is 234.8 ± 16.5, and it can be seen that the luminance change value of the luminance change value measurement region 73-3 is 254.0 ± 5.2. Further, in the case of “water 2” − “base”, the luminance change value of the luminance change value measurement region 73-1 is 138.4 ± 21.2, and the luminance change value of the luminance change value measurement region 73-2 is 193.0 ± 21.5, and it can be seen that the luminance change value of the luminance change value measurement region 73-3 is 254.9 ± 1.6.

  In FIG. 16, it can be seen that “oil” has less change in change from before application, and “water 1” and “water 2” have larger change. Further, it can be seen that “water 2” has a larger change than “water 1”.

  Here, FIG. 17 is a diagram illustrating an example of a luminance change before and after applying the latex in another embodiment. FIG. 18 is a diagram showing an example of the selection range pseudo color display corresponding to FIG.

  FIGS. 17 and 18 show changes immediately after application and 10 minutes after application ("water 1"-"base"), ("oil"-"base"), ("water 2"-" Base "). In addition, the lotion is shown in the application area 71 of the external preparation for skin. Also, the color of the difference image of the luminance change is shown differently for “water 1” and “water 2” and for “oil”. FIG. 17 shows that the color is dark in the application area 71 and the difference value is large. Further, the same luminance change is observed in the application region even after 10 minutes of application.

  FIG. 18 shows the above-described pseudo color selection range 72 and luminance change value measurement regions 73-4 and 73-5 under each condition. In the case of “water 1”-“base” in the change from before application immediately after application, the luminance change value of the luminance change value measurement region 73-4 is 134.0 ± 19.4, and the luminance change value measurement region It can be seen that the luminance change value of 73-5 is 247.4 ± 9.0. Further, in the change from before the application 10 minutes after the application, the luminance change value of the luminance change value measurement region 73-4 is 128.4 ± 30.3, and the luminance change of the luminance change value measurement region 73-5. It can be seen that the value is 233.1 ± 12.1.

  Also, in the change from before application immediately after application, in the case of “oil”-“base”, the luminance change value of the luminance change value measurement region 73-4 is 153.1 ± 24.9, and the luminance change value measurement. It can be seen that the luminance change value of the region 73-5 is 229.4 ± 15.9. Further, in the change from before the application 10 minutes after the application, the luminance change value of the luminance change value measurement region 73-4 is 143.6 ± 27.3, and the luminance change of the luminance change value measurement region 73-5. It can be seen that the value is 226.5 ± 15.9.

  Further, in the case of “water 2” − “base” in the change from before application immediately after application, the luminance change value of the luminance change value measurement region 73-4 is 69.5 ± 31.2, and the luminance change value It can be seen that the luminance change value of the measurement region 73-5 is 222.8 ± 15.3. Further, in the change from before the application 10 minutes after the application, the luminance change value of the luminance change value measurement region 73-4 is 79.8 ± 27.1, and the luminance change of the luminance change value measurement region 73-5. It can be seen that the value is 179.2 ± 17.0.

  As described above, by presenting the brightness change value for the brightness change value measurement area specified by the user, the change value for an arbitrary place can be easily presented, and the brightness difference can be easily clarified by a numerical value. Can grasp.

  In addition, since the above-mentioned image can be shown to a subject or a user in real time, makeup counseling can be performed while applying a skin external preparation.

  Furthermore, the acquired images can be managed and accumulated for each subject, statistical processing can be performed using a certain collected data, and evaluation over time can be performed. Moreover, skin, hair, etc. can be analyzed using 4 wavelengths.

<Skin Evaluation Method>
Next, specific examples of the evaluation method for the skin (skin) and the like in the evaluation means 46 described above will be described below.

<Example 1: Evaluation method of cleaning effect>
The evaluation means 46 in the present embodiment is based on the result analyzed by the image analysis means 45 described above, for example, the cleaning effect of the cleaning material by evaluating the skin exposure from the moisture distribution state analysis using a near-infrared image. Can be evaluated.

  Here, the contents described above will be specifically described as a first embodiment. Example 1 shows an example in which the effect of cleansing products on the skin to which foundation (FD) is applied is compared using a near infrared imaging method as an example.

  As a method for evaluating the cleaning effect, for example, the same foundation is applied to the left and right cheeks of the user, about 2 ml of two cleansing products are included in cotton, and after pressing for about 10 seconds, extra cleansing is performed with a tissue. Remove the product.

  Here, FIG. 19 is a diagram for explaining the application contents of two products for the evaluation method of Example 1. FIG. In FIG. 19, the two foundation (FD) products of Sample (Sample A) and Sample (Sample) B are applied to the left and right cheeks of the user before application, application, cleansing process, immediately after cleansing process, and cleansing. Various conditions for shooting after 15 minutes of processing are shown. In the example shown in FIG. 19, for example, imaging can be performed in each band of 1950 nm, 1775 nm, 1500 nm, 1460 nm, and 1300 nm as the near infrared region.

  Next, in Example 1, using a near-infrared camera (camera 24 shown in FIG. 2), images before FD coating, after FD coating, immediately after processing, and after 15 minutes of processing are acquired. In addition, about 15 minutes after a process, it implemented in order to confirm in the state in which the excess water | moisture content does not remain.

  Here, FIG. 20 is a diagram illustrating an example of an image photographed under the conditions of the first embodiment. FIG. 21 is a diagram showing the evaluation results under the conditions of Example 1. 20A and 20B show face images after FD application, after FD application, immediately after cleansing process, and after 15 minutes of cleansing, as an example, in which the near-infrared region is about 1950 nm. In addition, these images are subjected to image processing using a color chart corresponding to the photographed near-infrared region among the three color charts having different reflectances arranged near the jaw of the subject. Further, FIG. 20B shows an image in which the contrast is enhanced with respect to the image of FIG. 20A by further preset image processing.

  As shown in FIGS. 20A and 20B, by photographing in the near-infrared region in the above-described embodiment, the difference in skin condition can be easily grasped. Further, the difference in skin can be further clarified by adjusting the contrast as shown in FIG.

  In the image of the cleaning effect obtained by the near-infrared camera in FIG. 21, after applying the foundation shown in FIG. 21 (a), the portion where the foundation is applied for both sample A and sample B is darkly displayed. In addition, after 15 minutes of cleansing shown in FIG. 21 (b), the dark portion remains in sample A, but almost disappears in sample B. Therefore, it can be evaluated that the sample B has a higher cleaning effect.

<Example 2: FD adhesion state evaluation method>
The evaluation means 46 in this embodiment is based on the result analyzed by the image analysis means 45 described above, for example, for cosmetics such as a foundation by evaluating skin exposure from a moisture distribution state analysis using a near-infrared image. The adhesion state can be evaluated.

  Here, the contents described above will be specifically described as a second embodiment. In Example 2, an example in which a change with time after FD coating using the near-infrared imaging method is observed is shown as an example.

  In addition, as a method for evaluating the FD adhesion state, first, FDs having different makeup are applied to the left and right cheeks. Next, using a near infrared camera, images before FD coating, immediately after FD coating, and after 60 minutes are acquired.

  Here, FIGS. 22 to 25 are diagrams showing image examples (No. 1 to No. 4) obtained under the conditions of the second embodiment. First, in FIG. 22, when the liquid foundation (FD) is applied (FIG. 22 (a)) and when the powdery foundation (FD) is applied (FIG. 22 (b)), the comparison of the bare skin and immediately after the FD application A comparative evaluation was performed. In addition, the image of FIG. 22 has shown the image image | photographed as a near infrared region about 1500 nm.

  In the case of the liquid FD shown in FIG. 22A, since the FD is applied, the whole becomes whitish. Further, in the case of the powdery FD shown in FIG. 22B, since the FD is applied, the whole becomes whitish and the coating unevenness is displayed in gray. Therefore, the FD adhesion state can be evaluated by using the image shown in FIG.

  Further, as shown in FIG. 23, when the changes over time (time series) in the FD application are seen from the images taken for the face (after 5 minutes of face washing), immediately after application, and 6 hours after application, a white portion immediately after application You can see that it becomes a little gray. That is, by performing the image analysis as shown in FIG. 23, it is possible to determine how the FD is calm, and it is possible to evaluate the adhesion to the skin for each FD.

  Also, as shown in FIG. 24, when comparing the cheeks of the skin image immediately after application and after 6 hours, an image (near infrared) taken in the above-mentioned near infrared region as compared with a normal photograph (color image). The area image) shows the difference more clearly. Therefore, it can be seen that appropriate evaluation can be performed by using a near infrared region image as shown in FIG.

  Furthermore, in this embodiment, when the makeup generating application state by the near-infrared camera is imaged in the above-described image generation means 47 or the like, the makeup of the right face and the left face is made as shown in FIG. A non-existing image can be generated, a near-infrared camera image can also be generated as shown in FIG. 25 (b), and a change portion of the cosmetic application state as shown in FIG. 25 (c). It is also possible to generate a color image obtained by pseudo-coloring. By properly displaying each of the generated screens shown in FIGS. 25A to 25C described above, the FD adhesion state can be evaluated with high accuracy.

  As described above, the evaluation means 46 in the present embodiment can perform highly accurate evaluation by image analysis on the moisturizing effect of the cleaning material and the adhesion state of the cosmetic material. In addition, the evaluation means 46 may perform only either evaluation of a moisturizing effect or the adhesion state of cosmetics, and may perform both evaluations. These evaluation contents can be set in advance by a user or the like, for example, and can also be set in accordance with an object to be photographed.

  As described above, according to the present invention, skin analysis can be performed with high accuracy using an image in the near infrared region. Furthermore, it is possible to evaluate the skin and the like with high accuracy from the analysis result.

  In addition, according to the present invention, examination of the presence state of water in the base, imaging of the difference in water state due to prescription, enlarged skin image (applied state of water in the cuticle skin groove), enlarged hair image, Analysis such as imaging of nail moisture is also possible.

  Further, according to the present invention, it is possible to perform counseling by a counselor on how to apply makeup for each position or user for applying makeup, and it can also be widely used for evaluation of beauty methods.

  Specifically, according to the present invention, for example, a cleaning effect evaluation of a cleaning material by evaluating skin exposure from a moisture distribution state analysis using a near-infrared image, and a moisture distribution state using a near-infrared image It can be applied to makeup cosmetics application state evaluation such as a foundation (FD) adhesion state evaluation method by evaluating skin exposure from analysis.

  Furthermore, according to the present invention, as a new skin quality classification method by analyzing the distribution of specific components using a near-infrared image, a skin quality evaluation method using moisture and oil content distribution and a near-infrared image are used. It can be applied in a wide range of fields such as a skin quality evaluation program based on distribution state analysis, a moisturizing effect evaluation method for cleaning materials, and a moisturizing effect evaluation method for cleaning materials based on moisture distribution state analysis using near-infrared images.

  Furthermore, according to the present invention, it is possible to perform counseling by a counselor on how to apply makeup for each position where makeup is applied or for each user, and can also be widely used for evaluation of beauty methods.

  The preferred embodiments of the present invention have been described in detail above, but the present invention is not limited to such specific embodiments, and various modifications, within the scope of the gist of the present invention described in the claims, It can be changed.

DESCRIPTION OF SYMBOLS 10 Shooting system 11 Face imaging device 12 Image analysis device 13 Cable 21 Dome (housing)
DESCRIPTION OF SYMBOLS 22 Light source 23 Jaw mounting member 24 Imaging device 31 1st filter 32 2nd filter 33 3rd filter 41 Input means 42 Output means 43 Accumulation means 44 Captured image acquisition means 45 Image analysis means 46 Evaluation means 47 Image generation means 48 Control means 51 Input device 52 Output device 53 Drive device 54 Auxiliary storage device 55 Memory device 56 CPU
57 Network connection device 58 Recording medium 61 Area 62, 71 Application area 63, 72 Selection range 64, 73 Brightness change value measurement area

Claims (11)

In an image analysis method for analyzing the skin of a subject using face images of the subject photographed in a plurality of different near infrared regions,
An image acquisition step of acquiring the face image before and after applying a skin external preparation to the subject;
A luminance correction step for performing luminance correction on the image acquired by the image acquisition step;
A difference amount acquisition step of acquiring, for each of the plurality of different near infrared regions, a difference amount between images before and after applying the external preparation for skin obtained by the luminance correction step;
An analysis step of analyzing the skin of the subject based on the difference amount obtained by the difference amount acquisition step;
An image analysis method comprising: a screen generation step for generating a screen for displaying the analysis result obtained in the analysis step.   2. The image according to claim 1, wherein the plurality of near-infrared regions are at least two bands among 1100 to 1360 nm, 1300 to 1640 nm, 1860 to 2200 nm, 1700 to 1860 nm, and 2230 to 2400 nm. analysis method. The screen generation step includes
The screen according to claim 1 or 2, wherein a screen highlighted for each predetermined pixel with a color or pattern set in advance based on the magnitude of the difference amount obtained in the difference amount acquisition step is generated. Image analysis method. The analysis step includes
4. The luminance change value for a predetermined region in the screen set by a user is calculated from the analysis result screen obtained in the screen generation step. 5. Image analysis method. In the evaluation method for analyzing the skin of the subject using the face images of the subject photographed in a plurality of different near-infrared regions, and performing an evaluation using the analysis result,
An image acquisition step of acquiring the face image before and after applying a skin external preparation to the subject;
A luminance correction step for performing luminance correction on the image acquired by the image acquisition step;
A difference amount acquisition step of acquiring, for each of the plurality of different near infrared regions, a difference amount between images before and after applying the external preparation for skin obtained by the luminance correction step;
An analysis step of analyzing the skin of the subject based on the difference amount obtained by the difference amount acquisition step;
A screen generation step for generating a screen for displaying the analysis result obtained by the analysis step ;
An evaluation method comprising: an evaluation step for evaluating a moisturizing effect by a cleaning material on the skin of the subject and / or an evaluation of an adhesion state of a cosmetic using the analysis result obtained in the analyzing step. In an image analysis apparatus for analyzing the skin of a subject using face images of the subject photographed in a plurality of different near infrared regions,
Image acquisition means for acquiring the face image before and after applying a skin external preparation to the subject;
Luminance correction means for performing luminance correction on the image acquired by the image acquisition means;
A difference amount acquisition means for acquiring a difference amount between images before and after applying the external preparation for skin obtained by the brightness correction means for each of the plurality of different near infrared regions;
Analysis means for analyzing the skin of the subject based on the difference amount obtained by the difference amount acquisition means;
An image analysis apparatus comprising: a screen generation unit that generates a screen for displaying the analysis result obtained by the analysis unit.   The image according to claim 6, wherein the plurality of near-infrared regions are at least two bands among 1100 to 1360 nm, 1300 to 1640 nm, 1860 to 2200 nm, 1700 to 1860 nm, and 2230 to 2400 nm. Analysis device. The screen generation means includes
The screen according to claim 6 or 7, wherein a screen highlighted for each predetermined pixel is generated with a preset color or pattern based on a difference amount obtained by the difference amount acquisition unit. Image analysis device. The analysis means includes
9. The luminance change value for a predetermined region in the screen set by a user is calculated from the analysis result screen obtained by the screen generation means. Image analysis device.   7. An evaluation unit for evaluating a moisturizing effect of a cleaning material on the skin of the subject and / or evaluating an adhesion state of a cosmetic based on an analysis result obtained by the analyzing unit. The image analysis device according to any one of 9. In an image analysis program for analyzing the skin of a subject using face images of the subject photographed in a plurality of different near infrared regions,
Computer
Image acquisition means for acquiring the face image before and after applying a skin external preparation to the subject;
Luminance correction means for performing luminance correction on the image acquired by the image acquisition means;
A difference amount acquisition means for acquiring, for each of the plurality of different near infrared regions, a difference amount between images before and after applying the external preparation for skin obtained by the luminance correction means;
Analysis means for analyzing the skin of the subject based on the difference amount obtained by the difference amount acquisition means; and
An image analysis program for functioning as a screen generation unit that generates a screen for displaying an analysis result obtained by the analysis unit .