JP2011209265A - Lighting system and image analyzer - Google Patents

Abstract

PROBLEM TO BE SOLVED: To precisely photograph an image on a near-infrared region by having a plurality of filters.SOLUTION: The lighting system for photographing a face image of an object to be photographed on a plurality of different near-infrared regions by a photographing means, has: an enclosure with a spherical space formed therein, to store the whole face of the object to be photographed; at least two light sources singularly or plurally arranged at symmetrical locations of the object to be photographed on the spherical surface; a first filter installed on the front of the light source having a photographing means to photograph the whole face irradiated with light from the light source to cut off ultraviolet rays and infrared rays; a second filter installed on the front of the lens of the photographing means to adjust an amount of light; and a third filter to perform band-pass filtering corresponding to a plurality of different near-infrared regions. Thus, images on the near-infrared regions are precisely photographed.

Description

  The present invention relates to an illumination device and an image analysis device, and more particularly, to an illumination device and an image analysis device for photographing an image in the near infrared region with high accuracy.

  In recent years, a technique for visualizing a moisturizing liquid applied to the face surface using two near-infrared spectroscopic images using a near-infrared camera in order to visualize the moisture change of the face has been disclosed (for example, non- Patent Document 1).

  The technique shown in Non-Patent Document 1 is obtained by measuring a face using an InGaAs near-infrared camera (Sensors Unlimited, Inc. SU320M-1.7RT) having a sensitivity up to a wavelength of 900 to 1700 nm. Visualization of only the moisturizing liquid applied to the face is realized by converting to a differential absorbance image using the near-infrared spectroscopic image.

  Moreover, the method of discriminating the amount of skin moisture using near infrared is also disclosed (for example, refer patent document 1).

  The technique disclosed in Patent Document 1 includes a step of obtaining reflection intensity at a plurality of points on the skin in the near infrared wavelength range of 1050 to 1650 nm, a skin moisture content prepared in advance, and a reflection intensity in the near infrared wavelength range. Substituting the reflection intensity obtained in the above step into the prediction formula showing the relationship between the skin moisture content at a plurality of points and distinguishing the skin moisture content distribution from the obtained skin moisture content at a plurality of points. It is shown.

JP 2010-25622 A

Hiroaki Iwasaki et al., “Visualization of moisture change in face using two near-infrared spectral images”, The Optical Society of Japan (Applied Physics Society), Optics Japan 2005 Tokyo, November 23-25, 2005

  Here, in the above-described prior art, Non-Patent Document 1 shows that the wavelength at which strong absorption of water in the face is 1460 nm, while the wavelength without absorption of water is 1060 nm.

  However, the absorption of water (OH group) is also strong in the vicinity of 1920 nm, and the absorption of oil (CH group) is also in the vicinity of 1750 nm and 2230 to 2400 nm. Therefore, it is preferable to perform an image of skin moisture and oil content with high accuracy using these characteristics, but such a method has not yet been disclosed. Moreover, although it is necessary to change the concrete structure etc. about the illuminating device for acquiring the image of the above-mentioned wavelength, in patent document 1, the illumination for acquiring what is called a color image with respect to an ultraviolet region or a visible region Only the mechanism is shown, and no technique for irradiating an appropriate subject with a light source in the near infrared region is shown.

  Moreover, although it is preferable to perform analysis, evaluation, skin counseling, etc. with respect to the skin by using a plurality of portions where water or oil is strongly absorbed as described above, these methods are not disclosed.

  The present invention has been made in view of the above-described problems, and an object thereof is to provide an illumination device and an image analysis device for capturing an image in the near infrared region with high accuracy.

  In order to solve the above-described problems, the present invention employs means for solving the problems having the following characteristics.

  The invention described in claim 1 is an illuminating device for photographing a face image of a subject in a plurality of different near-infrared regions by an imaging means, and accommodates the entire face of the subject and has a substantially spherical space. And at least two light sources that irradiate light into the space of the casing, and light emitted from the light source. A first filter that blocks ultraviolet rays and infrared rays installed in front of the light source, and an amount of light installed in front of the lens of the imaging unit. And a third filter for performing band-pass filtering corresponding to the plurality of different near-infrared regions.

  According to the first aspect of the invention, an image in the near infrared region can be taken with high accuracy.

  The invention described in claim 2 is characterized in that a first light shielding plate is provided inside the casing so that the light from the light source is not directly irradiated onto the subject.

  According to the second aspect of the present invention, the subject can be irradiated with light uniformly.

  The invention described in claim 3 is characterized in that a second light shielding plate is provided in front of the lens of the imaging means.

  According to the invention of claim 3, stray light can be prevented.

  The invention described in claim 4 includes a slide mechanism for changing the types of the second filter and the third filter.

  According to invention of Claim 4, a setting can be changed easily and the image of the desired near-infrared area | region can be image | photographed.

  The invention described in claim 5 is characterized in that a predetermined paint is repeatedly applied to the inside of the casing.

  According to the fifth aspect of the present invention, the reflectance in the housing can be improved.

  The invention described in claim 6 is characterized in that the light source is a halogen light source or an LED for photographing a near infrared region.

  According to the sixth aspect of the present invention, it is possible to perform high-accuracy imaging using a halogen light source that has a uniform and gentle distribution at all wavelengths in the near-infrared region.

  The invention described in claim 7 is an image for analyzing the skin of a subject using face images of the subject in a plurality of different near-infrared regions photographed by the illumination device according to claims 1 to 6. An analysis apparatus, an image acquisition unit that acquires the face image before and after applying a skin external preparation to the subject, a luminance correction unit that performs luminance correction on the image acquired by the image acquisition unit, and the luminance correction unit Based on the difference amount obtained by the difference amount obtaining means, the difference amount obtaining means for obtaining the difference amount between the images before and after applying the external preparation for skin for each of the plurality of different near infrared regions, and the difference amount obtained by the difference amount obtaining means. It has an analysis means for analyzing the skin of a subject, and a screen generation means for generating a screen for displaying an analysis result obtained by the analysis means.

  According to invention of Claim 7, the image of a near-infrared area | region can be image | photographed with high precision. In addition, skin analysis can be performed with high accuracy using an image in the near infrared region.

  The invention described in claim 8 is that the plurality of near-infrared regions are at least two bands among 1100 to 1360 nm, 1300 to 1640 nm, 1860 to 2200 nm, 1700 to 1860 nm, and 2230 to 2400 nm. Features.

  According to the eighth aspect of the present invention, highly accurate skin analysis can be performed by acquiring an image in a region having high light absorption characteristics even in the near infrared region.

  The invention described in claim 9 is the screen in which the screen generation unit highlights each predetermined pixel with a color or pattern set in advance based on the difference amount obtained by the difference amount acquisition unit. Is generated.

  According to invention of Claim 9, the difference of the skin before and behind application | coating of a skin external preparation can be shown more clearly by highlighting.

  The invention described in claim 10 is characterized in that the analysis means calculates a luminance change value for a predetermined area in the screen set by the user from the analysis result screen obtained by the screen generation means. And

  According to the tenth aspect of the present invention, it is possible to quickly and accurately acquire a luminance change at a position desired by the user.

  According to the present invention, an image in the near infrared region can be taken with high accuracy.

It is a figure which shows an example of the absorption characteristic of the skin in a near infrared region. It is a figure which shows an example of schematic structure of the illumination system in this embodiment. It is a figure which shows the specific structural example of the illuminating device shown in FIG. It is a figure for demonstrating the example of a slide of the filter in this embodiment. It is a figure which shows an example of the color chart installed in the illuminating device in this embodiment. It is a figure which shows an example of a function structure of the image analysis apparatus in this embodiment. It is a figure which shows an example of the hardware constitutions which can implement | achieve the image analysis process in this embodiment. It is a flowchart which shows an example of the image-analysis processing procedure in this embodiment. It is a figure which shows an example of the imaging | photography result with the conventional illuminating device and the illuminating device in this embodiment. It is a figure which shows an example of the skin image before and after application of skin lotion. It is a figure which shows the brightness | luminance change before and after the lotion application in "water 1." It is a figure which shows the brightness | luminance change before and after the lotion application in "water 2." It is a figure which shows an example of the skin image before and behind application | coating of an emulsion. It is a figure which shows the brightness | luminance change before and behind the emulsion application | coating in "water 1." It is a figure which shows the luminance change before and behind the emulsion application | coating in "oil". It is a figure which shows the brightness | luminance change before and behind the emulsion application in "water 2". It is a figure which shows an example of the hair image before and after application | coating of hair treatment. It is a figure which shows an example of the brightness | luminance change before and after the lotion application in other embodiment. It is a figure which shows an example of the selection range pseudo | simulation color display corresponding to FIG. It is a figure which shows an example of the luminance change before and behind the emulsion application | coating in other embodiment. It is a figure which shows an example of the selection range pseudo color display corresponding to FIG.

<About the present invention>
The present invention provides illumination for acquiring images of each part of a desired subject with high accuracy from the face, hand, arm, foot, or hair of the subject using a near-infrared camera capable of photographing in the wavelength range of 800 to 2500 nm. The present invention relates to an apparatus and an illumination method thereof. Specifically, in addition to the absorption characteristics of water near 1460 nm, the image of the subject with respect to the absorption characteristics of oil near 1750 nm, the strong absorption characteristics of water near 1920 nm, and the strong absorption characteristics of a plurality of oils near 2230 to 2400 nm. To get. In addition, analysis or evaluation of skin or the like is performed on the acquired image.

  Here, FIG. 1 is a diagram showing an example of skin absorption characteristics in the near-infrared region. Here, the horizontal axis of the graph shown in FIG. 1 indicates the measurement wavelength (nm), and the vertical axis indicates the absorbance (Absorbance, A / W).

  In FIG. 1, the absorption characteristic with respect to the image | photographed wavelength in water, a palmitic acid, and glycerol is each shown to Fig.1 (a)-(d). 1 (a) shows the absorption characteristics of water, FIG. 1 (b) shows the absorption characteristics of palmitic acid, FIG. 1 (c) shows the absorption characteristics of glycerin, and FIG. 1 (d). Shows the absorption characteristics of the skin.

  The characteristic range shown in FIG. 1 (i) is a near red that can be taken with a commercially available camera (for example, “ALPHA NIR camera made by FLIR SYSTEMS”, “XEVA series InGaAs near infrared camera made by XenlCs”, etc.). FIG. 1 (ii) shows a near-infrared region that can be photographed by a camera used in the present invention (for example, manufactured by Sumitomo Electric Industries, Ltd.). A camera manufactured by Sumitomo Electric Industries, Ltd. can acquire an image in the near infrared region of about 1000 nm to 2500 nm.

  As shown in FIG. 1, in a region photographed by a commercially available camera, there is strong water absorption near 1460 nm (region A in FIG. 1D) as shown in the above-described conventional technology. However, since the region A overlaps with the peak of the characteristics of oil (paltimic acid) and humectant (glycerin), for example, when cosmetics are applied, it is easily affected by those components. If only the image is used, accurate skin analysis or the like cannot be performed.

  Here, as shown in the graph of FIG. 1 (d), it can be seen that the skin absorption characteristic has a strong absorption characteristic due to water in the vicinity of about 1920 nm in addition to the vicinity of about 1460 nm. Moreover, as shown in FIG.1 (b), in the absorption characteristic of oil, it turns out that an absorption characteristic exists in about 1700-1800 nm vicinity, and also a strong absorption characteristic exists also in about 2230-2400 nm vicinity.

  Therefore, in the present embodiment, in addition to an image near about 1460 nm with respect to water, an image of only water can be detected near about 1920 nm, so an image in the near infrared region is also acquired. In the present embodiment, near-infrared images of about 1700 to 1800 nm and about 2230 to 2400 nm are acquired for oil.

  In this way, by acquiring images of both water (OH group) and oil (CH group), and performing image analysis using one or more of the images, for example, skin external preparations such as skin lotions and emulsions. The state of the applied skin or the like is shown on the image and can be used for evaluation of uneven coating.

  Hereinafter, preferred embodiments of an illumination device and an image analysis device according to the present invention will be described with reference to the drawings.

<Lighting system: schematic configuration example>
First, a schematic configuration example of a lighting device that captures an image acquired in the present embodiment will be described with reference to the drawings. In the following example, an example of photographing the skin of the face is shown as an example of skin. However, the present invention is not limited to this. For example, in addition to hands and arms, skin substitutes (for example, pig skin) , Artificial skin, urethane), hair, nails and the like, and can be applied to anything for evaluating moisture and oil content.

  FIG. 2 is a diagram illustrating an example of a schematic configuration of the illumination system in the present embodiment. The illumination system 10 shown in FIG. 2 is generally configured to include an illumination device 11 and an image analysis device 12, and the illumination device 11 and the image analysis device 12 include a cable 13 and the like. They are connected in a state where data and control signals can be transmitted and received.

  The illumination device 11 sets the face of the subject to be analyzed, illuminates a predetermined part of the face with a predetermined light source that irradiates the sphere, and acquires the image by a camera or the like. At this time, in this embodiment, in order to acquire a face image of a subject photographed in a plurality of different near-infrared regions, filtering is performed using a preset bandpass filter to acquire image data in a predetermined near-infrared region. To do.

  In the present embodiment, when the face image of the subject is photographed by the lighting device 11, the color chart is photographed together with the face image. The color chart can be detachably attached to the lighting device 11. That is, in the present embodiment, shooting is performed so that not only the face of the subject but also the color chart appears in the shot image. As a result, image correction can be performed on the photographed image using the color chart, so that the accuracy can be improved. Note that one or a plurality of color charts can be provided, and when there are a plurality of color charts, for example, a color chart corresponding to the wavelength of the light source used at the time of photographing can be selected and used.

  Moreover, the illuminating device 11 can reduce noise by installing a polarizing filter etc. with respect to the lens of the camera to image | photograph. A specific example of the lighting device 11 will be described later.

  The image analysis device 12 acquires a plurality of predetermined near-infrared region images photographed by the illumination device 11, and performs analysis / evaluation of an image related to water and oil on the skin of the subject based on the acquired images. This makes it possible to visualize and output the state of the skin when applying a skin external preparation such as skin lotion or moisturizer, and the unevenness in the image, thereby performing highly accurate analysis and evaluation, or displaying the result. be able to. Note that the skin analysis device 12 can realize the analysis processing in the present embodiment using a general-purpose personal computer or the like.

  Here, as the skin external preparation in the present invention, for example, an aqueous solution system, a solubilization system, an emulsification system, a powder dispersion system, a water-oil two-layer system, a water-oil-powder three-layer system, etc. It can be applied to not only lotions and emulsions, but also basic cosmetics such as creams and packs, makeup cosmetics such as lipsticks and foundations, hair products such as shampoos, rinses and hair dyes. It covers a wide range of fields such as special cosmetics such as sunscreen.

<Lighting device 11: specific example>
Next, the illuminating device 11 in this embodiment is demonstrated concretely. FIG. 3 is a diagram illustrating a specific configuration example of the illumination device illustrated in FIG. 2. 3A to 3C show views of the illumination device 11 shown in FIG. 2 as viewed from the directions of arrows A, B, and C. FIG.

  The illuminating device 11 shown in FIG. 2 slides on a base 20 as a substantially spherical dome (housing) 21, at least one light source 22, a chin rest member 23, a camera 24 as an imaging device, and a slide mechanism. A rail 25 and a camera base 26 are shown as part of the configuration.

  In the illuminating device 11 shown in FIGS. 2 and 3, the dome 21 has a substantially spherical shape, and the inside of the sphere is hollow. Further, the dome 21 has a shape with a diameter of about 40 cm to 90 cm, for example, so that a face of a person who is a subject enters. Thus, by making the shape of the dome 21 spherical, the light emitted from the internal light source is diffused, and the face of the subject can be efficiently irradiated uniformly (flat). Further, in this embodiment, by making the integrating sphere into a dome shape, regular reflection light (light) on the skin surface of the subject can be suppressed, and a highly accurate image can be taken.

  The material of the dome 21 can be formed of foamed polystyrene, resin, or the like, but the present invention is not particularly limited, and light diffuses inside the dome 21 and is efficiently and uniformly applied to the subject's face. Can be irradiated.

  In addition, as the inner surface (reflection surface, diffusion surface) of the dome 21, for example, a silver surface, an aluminum special alloy electrolytic polishing surface, a glass mirror surface (aluminum alloy), a specular reflective material such as mercury, gold, platinum, copper, Magnesium carbonate, barium sulfate, aluminum oxide, white paint, enamel, white paper, white tile and the like can be used. Furthermore, in this embodiment, the same paint is applied several times to improve the reflectance.

  In addition, when painting the inner surface of the dome 21, for example, a spray type or a pen type is used. Also, the paint can be acrylic, lacquer, enamel, etc. For example, about five types of paints having different compositions are used to measure the spectral reflectance in the near infrared region, and the near infrared region. All of them can be selected from paints and the like that have a small change in spectral reflectance and have a high reflectance.

  Moreover, it is preferable that the inner surface of the dome 21 is formed so that the spectral reflectance changes between about 80% and 100% in the measurement wavelength region where the spectral characteristic is at least 1000 nm to 2500 nm.

  Further, as shown in FIG. 3C, the light from the light sources 22-1 and 22-2 is directly irradiated on the subject in the dome 21, so that there is no variation in the light irradiated on the face. Therefore, in this embodiment, as shown in FIG. 3C, light source pre-shielding plates 30-1 and 30-2 are provided. In addition, although the light source front light shielding plates 30-1 and 30-2 shown in FIG. 3C are on both sides of the light sources 22-1 and 22-2, in the present embodiment, the present invention is not limited to this. Only a light shielding plate may be provided. The light shielding plate 30 is installed on the inner surface of the dome 21 and has an L shape, a crescent shape, a semicircular shape, or the like, and is installed so that the subject photographed from the camera 24 is not hidden.

  Further, as shown in FIGS. 3A to 3C, the dome 21 is provided with a lens front light shielding plate 31. The lens front light shielding plate 31 is a cylindrical tube, and the inside of the tube is formed of a near infrared region absorbing material. In this manner, stray light can be removed by providing the pre-lens light shielding plate 31. In addition, the lens front light shielding plate 31 is formed of, for example, a near infrared region absorbing material on the inner side. As a specific example of the absorbent material, for example, neoprene rubber sponge can be used, but other materials may be used.

  The dome 21 is fixed by, for example, a strong magnet so as not to move. The light source 22 directly irradiates the inside of the dome 21 installed on the base 20 with the light source. Note that the number of the light sources 22 may be at least one (in the case of FIGS. 2 and 3, two on the left and right sides of the face). Note that the installation position of the light source differs depending on the position of the shadow of the face of the subject due to the irradiation, and thus needs to be adjusted. The arrangement of the light source 22 in the dome 21 will be described later.

  The light sources 22-1 and 22-2 emit light to measure the near infrared region. Therefore, as the light sources 22-1 and 22-2, for example, a halogen lamp or the like can be used. For example, JD110V50W / P / M manufactured by Iwasaki Electric Co., Ltd. can be used. It is not limited to.

  For example, a halogen lamp can be used as the light source 22, but the present invention is not limited to this. For example, a temperature irradiation light source such as an incandescent bulb / halogen bulb, a high-pressure mercury lamp, a self-ballast High pressure discharge lamps (discharge light source) such as mercury lamp, metal halide lamp, high pressure sodium lamp, constant pressure discharge lamp (discharge light source) such as fluorescent lamp, low pressure sodium lamp, EL (Electroluminescence), LED (Light Emitting Diode), etc. An electroluminescent light source or the like can be used.

  As for halogen, for example, a halogen lamp, a double-ended die halogen, a PAR lamp, a dichroic mirror, or the like can be used. The fluorescent lamp can be replaced with a general illumination lamp, a reflex lamp, a krypton lamp, a mercury lamp, a ballastless mercury lamp (chalkless), a high-pressure sodium lamp, a metal halide lamp, an HQI lamp, or the like.

  In the present embodiment, it is preferable to use, for example, a halogen light source or an LED in order to photograph, for example, the near infrared region. The above two light sources can emit the same band, but there are differences depending on the properties of the materials. Specifically, the halogen light source and the LED are different in how light spreads, and the LED is more linear than the halogen light source. Also, LEDs emit less heat than halogen light sources. Therefore, in the present embodiment, which one of the halogen light source and the LED light source is used is appropriately set according to the subject to be photographed, the purpose of photographing, the photographing environment, and the like.

  In addition, in the illuminating device 11, the slide member, an arm member, etc. should just be attached, for example so that the installation position of the light source 22 can be changed in general up and down and right and left. Accordingly, the light source can be moved freely in the vertical and horizontal directions, and further, the light source can be fixed at a desired position by a fixing member such as a screw by sliding in the horizontal direction with the camera.

  The chin rest member 23 is a holding member that allows a subject to enter inside the dome 21 and hold and fix it at a predetermined position. The chin rest member 23 may be provided with a pedestal 32 or the like as shown in FIGS. 3A and 3B, for example, so that the chin is placed on the pedestal 32 and held. The chin rest member 23 may include a forehead holding member 33 that holds the forehead at a predetermined position.

  Further, the chin rest member 23 is provided with a mechanism for adjusting the height of the pedestal 32 and adjusting the left and right positions. For example, an image photographed from the camera 24 or the like is displayed on the display of the image analysis device 12, and the camera It is also possible to have a scale or the like that can adjust the vertical and horizontal positions of the center and face. In addition, the chin rest member 23 has a configuration or a moving mechanism that can acquire a side image and a hair image in an oblique, lateral, or rearward direction instead of a front image of a subject.

  3A, after the subject puts the face into the dome 21 from the opening 34, light does not enter the gap between the opening 34 and the head. Further, by covering the periphery with an elastic member such as a sponge or a cushion, the light from the light source 22 inside the dome 21 can be prevented from going outside.

  The camera 24 includes cameras 24-1 and 24-2 as imaging devices. The camera 24-1 can be a near-infrared camera (for example, manufactured by Sumitomo Electric Industries, Ltd.), and the camera 24-2 can be a visible camera (for example, Nikon D50, 60 mm lens). ) Can be used. The camera 24-1 and the camera 24-2 are provided with a slide rail 25 as a slide mechanism. The camera 24-1 and the camera 24-2 are slid to a position where a subject can be seen from a lens attached to each of the cameras 24-1 and 24-2. be able to. Therefore, in this embodiment, a plurality of cameras can be selected and photographed according to the target wavelength band to be photographed. Furthermore, the positions of the cameras 24-1 and 24-1 with respect to the dome 21 can be adjusted by a slide mechanism provided on the camera base 26.

  Here, the camera 24-1 acquires the image of the predetermined near infrared region described above. Specifically, a near-infrared camera (for example, manufactured by Sumitomo Electric Industries, Ltd.) capable of acquiring an image in a wavelength band near about 800 to 2500 nm can be used. Further, as a lens attached to the camera 24, for example, a 25 mm lens manufactured by Fujinon Corporation can be used. In the present embodiment, a polarizing filter may be provided in order to eliminate noise such as surface reflection of a face image of a subject to be photographed and suppress a glare on the surface to obtain a clear image. A specific example of the polarizing filter will be described later.

  The camera 24-2 is a visible camera for photographing the same area of the same subject, for example, before or after the subject is photographed by the camera 24-1. Thereby, the water | moisture content and oil-component image image | photographed with the camera 24-1 can be displayed on an image obtained with the camera 24-2.

  In the present embodiment, in order to acquire an image in a predetermined near infrared region, for example, a band pass filter is installed in front of the light source or in front of the lens to acquire an image in the predetermined near infrared region. In the present embodiment, in order to capture images from a plurality of different near-infrared regions, for example, a mechanism that can be automatically switched by sliding a filter may be provided. Then, the filter may be switched.

  Here, the filter in the present embodiment includes first filters 35-1 and 35-2 that pass light between the light sources 22-1 and 22-2 and the subject, light reflected by the subject, and a camera (lens). ) Between the second filter 36 and the third filter 37. Here, as the first filter 35, for example, a UVA cut or an infrared attenuation filter can be used. For example, GG395 manufactured by SCHOTT (for example, a thickness of about 3 mm, about 100 × 100 mm) or the like can be used.

  Furthermore, the second filter 36 is an ND filter that is used, for example, in combination with a band-pass filter (third filter 37) described later. The ND filter is a filter for adjusting the amount of light entering the lens, and is for adjusting the amount of light that varies depending on the type of bandpass filter. The second filter 36 and the third filter 37 have a filter slide mechanism 38 so that the respective filters can be changed by sliding in order to obtain a plurality of preset images of different near infrared regions. (FIG. 3C). By providing the filter slide mechanism 38 shown in FIG. 3C, the types of the second filter 36 and the third filter in front of the lens and the presence or absence of the filter can be easily changed.

  Here, FIG. 4 is a diagram for explaining a filter slide example in the present embodiment. In the example shown in FIG. 4, the second filter 36 and the third filter 37 are set on the filter slide mechanism in a state where they are overlapped. The filter slide mechanism 38 is provided with five openings 39-1 to 39-6, and a second filter 36 for acquiring images of a plurality of predetermined different near-infrared wavelength regions therein. And the third filter 37 is set to overlap.

  Here, a filter for acquiring an image around 1300 nm is installed in the opening 39-1, and a filter for acquiring an image around 1460 nm is installed in the opening 39-2. In the opening 39-3, a filter for obtaining an image around 1750 nm is installed, and in the opening 39-4, a filter for obtaining an image around 1920 nm is installed. In the section 39-5, a filter for acquiring an image around 2300 nm is installed.

  Note that nothing is set in the opening 39-6, which is used when photographing without a filter. Therefore, in order to acquire an image of a preset near-infrared region, the filter in front of the lens is changed by moving the slide mechanism 38 to the left and right shown in FIG. A plurality of different images can be easily acquired. Note that the slide operation may be performed automatically by providing a slide control mechanism in advance, and the user or the like has a reference wavelength band described in the slide mechanism as shown in FIG. 4 (for example, 1300 in the example of FIG. 4). , 1500, 1700, 1900, 2300) may be manually changed by sliding.

  Here, the types and number of filters, the position and sliding direction of the opening 39 in the filter slide mechanism 38, the amount of light adjusted in the second filter 36, the installation position in the third filter 37, the bandpass conditions, etc. However, the present invention is not limited to this. Therefore, for example, the slide mechanism may be circular, and the filter may be changed by rotation based on a predetermined axis.

  In this embodiment, images of a predetermined near-infrared region are acquired using a plurality of bandpass filters. However, since the amount of transmitted light varies depending on the wavelength, measurement can be performed without changing camera settings as much as possible. Is preferred. Accordingly, a plurality of ND filters (second filters) described above are prepared corresponding to a plurality of bandpass filters (third filters), and the amount of light is attenuated and adjusted by appropriately switching and using the amount of light. Can do. As the ND filter, for example, NG5 manufactured by SCHOTT (for example, a circle having a diameter of 25.4 mm, a thickness of 1 mm) or the like can be used.

  Here, for example, a filter manufactured by Spectrogon can be used as the third filter 37 for acquiring an image in a predetermined near-infrared band using a plurality of bandpass filters. In addition, for example, when acquiring a base image, the region of the third filter 37 can acquire an image obtained from a band of about 1100 to 1360 nm, for example, and the center wavelength is about 1300 nm ± 40 nm. Get a degree image.

  Further, when acquiring an image with strong water absorption characteristics, for example, when acquiring an image for the region A in FIG. 1D, an image obtained from a band of about 1300 to 1640 nm is acquired. Preferably, an image having a center wavelength of about 1460 nm ± 45 nm is acquired. Similarly, when acquiring an image with higher sensitivity and water absorption characteristics, for example, when acquiring an image for the region B in FIG. 1D, the image is obtained from a band of about 1860 to 2200 nm, for example. An image with a center wavelength of about 1920 nm ± 55 nm or so and about 1950 nm ± 56 nm is preferably obtained.

  In addition, when acquiring an image having a strong oil absorption characteristic as shown in the region C in FIG. 1B, an image obtained from a band of about 1700 to 1860 nm can be acquired. An image of about 1775 nm ± 50 nm or 1755 nm ± 20 nm is acquired. Furthermore, when acquiring an image having a strong oil absorption characteristic as shown in the region D in FIG. 1B, an image obtained from a band of about 2230 to 2400 nm, for example, can be acquired. An image having a wavelength of about 2345 nm ± 50 nm is acquired. Since there are a plurality of peaks in the region D, an image using one of the wavelengths may be acquired, or an image may be acquired from a plurality of wavelengths that are peaks. Further, in the band of about 2230 to 2400 nm, the difference in water absorption characteristics is large as shown in FIG. 1A. Therefore, in this embodiment, the band is appropriately set according to the conditions (drying, humidity, etc.) of the object to be imaged. Can be set.

  In addition, the filter used in order to acquire the image of these near-infrared bands may be implement | achieved in one filter, and may combine several filters.

  Furthermore, in this embodiment, for example, as shown in FIGS. 3A and 3B, the color chart 40 may be installed in front of the pedestal 32 (on the camera side) facing the camera 24 side. Accordingly, the face image of the subject and the color chart 40 can be included in the image photographed by the camera 24, and the accuracy can be improved by performing correction between a plurality of images using the color chart 40. it can. A specific example of the color chart will be described later.

  The face image of the subject photographed from the camera 24 using the illumination device 11 having the above-described configuration or the like is output to the image analysis device 12 via the cable 13 shown in FIG. Note that the communication between the illumination device 11 and the image analysis device 12 may be wireless communication using, for example, infrared rays or wired communication via a LAN cable or the like. Furthermore, the captured image may be transmitted to the image analysis device 12 at a remote location using a communication network such as the Internet.

  Here, the image photographed in the present embodiment is, for example, an image after applying a skin external preparation such as skin lotion or emulsion on a subject, immediately after application, after application, and after a predetermined time has elapsed after application. .

  In the present embodiment, the image captured by the lighting device 11 may be an image captured according to a user instruction or a real-time image captured continuously. Furthermore, the image photographed by the lighting device 11 is limited to the skin (cheek, forehead, etc.) of the subject included in the face, eyelids, eyes, under the eyes, around the eyes, nose, mouth, mouth, ears, eyebrows, jaws, etc. For example, it includes a neck and hair, and further includes an arm, a hand, a foot, and the like. Therefore, the content analyzed by the image analysis device 12 can correspond to all the images obtained by the lighting device 11 described above.

<About polarizing filter>
Next, a specific example of the polarizing filter in the present embodiment described above will be described. In general, when an image is captured, reflected light (such as glare) unnecessary for analysis on the surface of the observation target due to the light source may occur. Further, unnecessary reflected light affects the luminance value of the acquired image, which may cause an error when performing quantitative evaluation by image analysis.

  Therefore, in the present embodiment, polarizing filters are installed in the front part, rear part, or both of the cameras 24-1 and 24-2. In the present embodiment, a polarizing filter may be provided not at the vicinity of the lens but at the front of the light source. Furthermore, in this embodiment, a polarizing filter is installed in both the lens and the light source. One or more polarizing filters can be installed.

  Thereby, in this embodiment, the reflected light unnecessary for the analysis which arises on the observation target object surface can be removed. Moreover, in this embodiment, noise can be reduced by installing these filters, and highly accurate analysis can be performed.

<About color chart>
Next, a specific example of the color chart 40 in the above-described embodiment will be described. Usually, when comparing between images using quantitative evaluation by image analysis, it is an analysis problem that a slight difference is caused depending on photographing conditions. Therefore, in the present embodiment, by correcting the luminance value of the acquired image using an arbitrary color chart 40 that can specify the reflectance of white to black, it is possible to compare the images regardless of the timing of image acquisition. Therefore, it is possible to analyze with high accuracy.

  Here, the color chart 40 provided in the illuminating device 11 of this embodiment is demonstrated using figures. FIG. 5 is a diagram illustrating an example of a color chart installed in the illumination device according to the present embodiment. 5A shows a view of the color chart board on which the color chart is arranged from above, and FIG. 5B shows a view of the color chart board viewed from the camera 24 side.

  As an example, the color chart 40 shown in FIGS. 5A and 5B has three color charts having different reflectivities arranged in parallel on the board. For each color chart shown in FIG. 5, for example, a color chart can be selected according to the wavelength of the light source used when photographing the subject. By using the color chart 40 in this way, it is possible to correct the luminance between captured images.

  Also, the color chart 40 shown in FIG. 5 is installed at a position where the subject is photographed together with the subject when the subject is photographed by the camera 24. In the present embodiment, for example, the color chart 40 is installed in front of the pedestal 32 of the subject so as to face the camera. Specifically, for example, the lower part of the color chart board shown in FIG. 5 is installed so as to be fitted into the unevenness provided in advance on the chin rest member 23 side of the illumination device 11. Accordingly, the color chart 40 can be easily attached and detached, and the color chart 40 can be switched as necessary, such as the performance and accuracy of the camera, the type and wavelength of the light source, and the like.

  In the present invention, the number, size, shape, and luminance and arrangement of the color charts are not limited to the example shown in FIG. 5, and at least one color chart is installed. It only has to be.

<Image Analysis Device 12: Functional Configuration Example>
Next, an embodiment of the image analysis apparatus 12 in the present embodiment will be described with reference to the drawings. FIG. 6 is a diagram illustrating an example of a functional configuration of the image analysis apparatus according to the present embodiment. The image analysis apparatus 12 illustrated in FIG. 6 includes an input unit 41, an output unit 42, a storage unit 43, a captured image acquisition unit 44, an image analysis unit 45, an image generation unit 46, and a control unit 47. It is configured as follows.

  The input unit 41 receives input from the user or the like such as start / end of various instructions such as an image acquisition instruction, an image analysis instruction, and an evaluation instruction. Note that the input unit 41 includes, for example, a keyboard and a pointing device such as a mouse. The input unit 11 also has a function of inputting an image including an imaging part of a subject photographed by an imaging unit such as a digital camera.

  The output unit 42 displays / outputs the content input by the input unit 41 and the content executed based on the input content. Note that the output means 42 includes a display, a speaker, and the like. Further, the output unit 42 may have a function of a printer or the like. In that case, the image analysis result or the like can be printed on a printing medium such as paper and provided to a user or a subject.

  The input means 41 and the output means 42 may be integrated input / output means such as a touch panel, for example. In this case, the input means 41 and the output means 42 may be predetermined using a user's finger or a pen-type input device. Input can be made by touching the position.

  The storage unit 43 stores various data such as image information obtained by the captured image obtained by the captured image acquisition unit 44, the image analysis result by the image analysis unit 45, the evaluation result generated by the image generation unit 46, and the like. In addition, the storage unit 43 can read out various data stored as necessary.

  The captured image acquisition unit 44 acquires a face image of the subject captured by the camera 24 in the illumination device 11. The photographed image acquisition unit 44 can set, for example, the type, position, number, and the like of the light source to be used according to the contents of the photographed image when photographing the subject's face with the lighting device 11. Further, the captured image acquisition means 44 uses the first to third filters 35 to 37 described above in combination with the camera 24 of the lighting device 11, so that a predetermined proximity filtered by a predetermined bandpass filter is used. In order to acquire an image in the infrared region, instruction information indicating the photographing condition is generated and output to the illumination device 11. The image acquired by the captured image acquisition unit 44 is stored in the storage unit 43.

  The image analysis unit 45 performs luminance correction and calculation of an average luminance value on the image obtained by the captured image acquisition unit 44, analysis of luminance change before and after application of a skin external preparation such as skin lotion and emulsion, and luminance change value. Analysis of calculation, setting of pseudo color corresponding to the luminance difference for the region selected by the user, and the like is performed. The image analysis means 45 can analyze the skin from these images using the images before application, immediately after application, and after application, and evaluate the results. Further, the image analysis means 45 may be performed on the entire skin of the face where the image analysis portion is photographed, and image analysis is performed only on an area designated by the user or the like using the input means 41 or the like. You may go. The designated area may be one or plural.

  Furthermore, in the present embodiment, the image analyzed by the image analysis unit 45 may be analyzed in real time each time while being captured from the lighting device 11, or analyzed using an image stored in the storage unit 43 in advance. Also good.

  The image analyzed by the image analysis means 45 is, for example, a skin image such as a cheek or forehead, and skin image analysis can also be performed on images such as arms, hands, and feet. Furthermore, the image analysis means 45 can also analyze hair. A specific example of processing in the image analysis unit 45 will be described later.

  The image generation unit 46 generates an image to be presented to the user based on the result analyzed by the image analysis unit 47. Specifically, the image generation unit 46 combines pseudo colors corresponding to the luminance differences analyzed by the image analysis unit 45 and displays the combined image on the screen.

  Note that the image generation unit 46 performs processing such as enlargement of a luminance region for a predetermined region, calculation of a difference image, luminance reversal, etc., in order to display the composite image on the screen in an easy-to-view manner for the user. It can also be displayed.

  Further, the image generation unit 46 performs processing such as pseudo color generation for an area set by the user in the image. A specific process in the image generation unit 46 will be described later.

  The control unit 47 controls the entire components of the image analysis apparatus 12. Specifically, the control unit 47 performs various controls such as an image analysis process and an image generation process based on, for example, an instruction from the input unit 41 by a user or the like.

<Image Analysis Device 12: Hardware Configuration>
Here, in the image analysis apparatus 12 described above, an execution program (image analysis program) that can cause a computer to execute each function is generated, and the execution program is installed in, for example, a general-purpose personal computer or server. Analysis can be performed using images in a predetermined near-infrared region taken before and after application of the external preparation for skin in the present invention and after a predetermined time has elapsed after application.

  Here, a hardware configuration example of a computer capable of realizing the image analysis processing according to the present embodiment will be described with reference to the drawings.

  FIG. 7 is a diagram illustrating an example of a hardware configuration capable of realizing the image analysis processing according to the present embodiment. 7 includes an input device 51, an output device 52, a drive device 53, an auxiliary storage device 54, a memory device 55, a CPU (Central Processing Unit) 56 for performing various controls, and a network connection device. 57 are connected to each other by a system bus B.

  The input device 51 has a pointing device such as a keyboard and a mouse operated by a user or the like, and inputs various operation signals such as execution of a program from the user or the like. In addition, the input device 51 is configured to capture an object photographed after application of an external preparation for skin or after exposure to near infrared rays in an already measured evaluation target site obtained from an external device connected to the network connection device 57 or the like via a communication network. Various data such as a face image can also be input.

  The output device 52 has a display for displaying various windows and data necessary for operating the computer main body for performing processing according to the present invention, and displays the program execution progress, results, and the like by the control program of the CPU 56. can do. Further, the output device 52 can print the above processing result or the like on a print medium such as paper and present it to the user or the like.

  Here, the execution program installed in the computer main body in the present invention is provided by, for example, a portable recording medium 58 such as a USB (Universal Serial Bus) memory, a CD-ROM, or a DVD. The recording medium 58 on which the program is recorded can be set in the drive device 53, and the execution program included in the recording medium 58 is installed in the auxiliary storage device 54 from the recording medium 58 via the drive device 53.

  The auxiliary storage device 54 is a storage means such as a hard disk, and can store an execution program according to the present invention, a control program provided in a computer, etc., and perform input / output as necessary.

  The memory device 55 stores an execution program or the like read from the auxiliary storage device 54 by the CPU 56. The memory device 55 includes a ROM (Read Only Memory), a RAM (Random Access Memory), and the like.

  The CPU 56 controls processing of the entire computer, such as various operations and input / output of data with each hardware component, based on a control program such as an OS (Operating System) and an execution program stored in the memory device 55. Thus, each processing can be realized. Various information necessary during the execution of the program can be acquired from the auxiliary storage device 54, and the execution result and the like can also be stored.

  The network connection device 57 obtains an execution program from another terminal connected to the communication network by connecting to a communication network or the like, or an execution result obtained by executing the program or an execution in the present invention The program itself can be provided to other terminals.

  Further, the network connection device 57 acquires various data such as a skin image of a subject photographed after application of an external skin preparation or after exposure to ultraviolet rays at an evaluation target site that has already been measured by an external device connected to a communication network. You can also.

  With the hardware configuration as described above, the image analysis processing in the present invention can be executed. Further, by installing the program, the image analysis processing according to the present invention can be easily realized by a general-purpose personal computer or the like.

<Image analysis processing procedure>
Next, an image analysis processing procedure in the present embodiment will be described. FIG. 8 is a flowchart showing an example of an image analysis processing procedure in the present embodiment.

  In the image analysis process shown in FIG. 8, first, a face image of a subject before application of a skin external preparation, which is a base, is acquired (S01), and further, a face image of a subject after application of a skin external preparation is acquired (S02). The image acquired in the processing of S01 and S02 is a subject image in a predetermined near infrared region filtered by the above-described filter or the like using a light source such as a halogen lamp in the above-described illumination device 11 or the like. To do.

  In the process of S01, a base image may be acquired in advance and stored in a storage unit or the like.

  In addition, after applying the external preparation for skin, it is preferable that a predetermined time elapses to such an extent that the effect is seen. The elapsed time varies depending on the external preparation for skin, the amount applied, the site applied, and the like. Therefore, the image acquired in the process of S02 may be, for example, an image immediately after application of the external preparation for skin, and further, an image after a predetermined time has elapsed since application (for example, after 10 minutes or 30 minutes). May be acquired continuously. Further, a plurality of these images may be acquired over time at predetermined time intervals. Further, the image acquired in the process of S02 is analyzed and evaluated in comparison with the image of S01 in the subsequent stage.

  Next, luminance correction is performed on the images obtained in S01 and S02 (S03), and a difference image between the two images is generated using the luminance corrected images (S04). Note that the processing of S03 and S04 may be performed on the entire acquired image set in advance, or may be performed on an area (one or more) in the image set in advance by the user or the like.

  Next, in the process of S04, a pseudo color preset according to the magnitude of the luminance difference value is assigned to the obtained difference image for each predetermined pixel in the region (S05), and the assigned pseudo image is further assigned. The color is combined with the difference image to generate an evaluation screen or the like (S06), and the generated image is displayed on the screen (S07).

  Here, it is determined whether or not to perform analysis using another image (S08). When analysis using another image is performed (YES in S08), the process returns to S03 and uses the other image acquired in the process of S02. Then, the processing described later is performed to analyze and evaluate the image.

  Here, when the image is analyzed, the evaluation may be performed using a preset pseudo color as an index as described above. It should be noted that the index may be derived in advance by using an index that is set in advance, or may be arbitrarily set based on the evaluation target site, the component of the external preparation for skin, the content of the index that has already been derived and evaluated, and the like. Thereby, skin conditions, such as the nonuniformity after apply | coating a skin external preparation to a user, can be evaluated simply and for a short time.

<Example of image acquisition and image analysis>
Next, specific examples of image acquisition and image analysis in the present embodiment will be described.

  First, an image example acquired by the illumination device 11 in the present embodiment will be described in comparison with an image photographed by a conventional illumination device.

  FIG. 9 is a diagram illustrating an example of a photographing result of the conventional lighting device and the lighting device in the present embodiment. FIG. 9A shows an example of images of “base”, “water 1”, “oil”, and “water 2” taken with a conventional lighting device, and FIG. 9B shows this embodiment. Shows an example of images of “base”, “water 1”, “oil”, and “water 2” taken by the lighting device 11 in FIG.

  Here, “base” indicates an image acquired at a center wavelength of about 1300 nm ± 40 nm, “water 1” indicates an image acquired at a center wavelength of about 1500 nm ± 45 nm, and “oil” indicates a center wavelength. An image acquired at approximately 1775 nm ± 50 nm is shown, and “water 2” indicates an image acquired at a center wavelength of approximately 1920 nm ± 55 nm.

  In the conventional example shown in FIG. 9A, the regular reflection light appears white in the uneven parts such as the cheekbones and the heels in any of “base”, “water 1”, “oil”, and “water 2”. However, in the present embodiment shown in FIG. 9B, it is possible to acquire a highly accurate image without shine.

  The acquisition of the image of the oil is not limited to the above-described center wavelength. For example, a similar image is acquired even when using a band of about 2230 to 2400 nm (preferably a band having a center wavelength of about 2345 nm ± 50 nm). can do. The same applies to the following description.

Next, an example of an analysis image will be described. In this example, “(1) Moist lotion applied to the left cheek with cotton and analyzed immediately before and after application” and “(2) Moist latex applied to the left cheek with cotton and before application. , “Examples analyzed immediately after application and 10 minutes after application” and “(3) Examples in which hair treatment for laying on the left hair is sprayed and analyzed immediately before application and immediately after application” will be described.
<(1) Before and after applying lotion>
FIG. 10 is a diagram showing an example of a skin image before and after applying lotion. In the example shown in FIG. 10, images of “base”, “water 1”, and “water 2” before and immediately after application are shown. Here, the regions 61-1 to 61-3 immediately after application shown in FIG. 10 indicate portions where the skin external preparation (skin lotion in the example of FIG. 10) is applied.

  All the images shown in FIG. 10 have been subjected to luminance correction in the present embodiment. Luminance correction is, for example, calculating an average value in a predetermined pixel unit (for example, 20 × 20 pixels) in an image, and setting the image to black with a luminance of 30 and gray with a luminance of 120 at two points. Correct the whole. Thereby, the noise on an image can be reduced and an image can be smoothed.

  According to FIG. 10, when there is water, it is displayed in black, and particularly in the near-infrared region of “water 2” in the present embodiment, that portion is black in the applied region 61-3. Recognize.

<Example of analysis>
Next, a specific analysis example in the present embodiment when a skin external preparation (skin lotion, emulsion) is applied will be described with reference to the drawings.

<Coating lotion: Example 1>
FIG. 11 is a diagram showing a luminance change before and after application of the skin lotion in “water 1”. In the example shown in FIG. 11, an example in which the difference from the base image before and immediately after application is imaged, and an example in which the difference is displayed in pseudo color within the selection range are shown. Further, in the example of FIG. 11, in order to correct the reflection on the skin surface to some extent, after the luminance correction, a difference image obtained by subtracting the base image from the “water 1” image was calculated. In this image, the portion where water is applied is displayed in white.

  In the example of FIG. 11, lotion is applied to the application region 62 and the user selects the predetermined selection range 63 by dragging or the like using the input means 41 such as a mouse, and an image is displayed in the selection range. The pseudo color is set by the analyzing unit 45 and the result is displayed by the image generating unit 46.

  In the present embodiment, the pseudo color represents a preset color or pattern according to the luminance difference. That is, pseudo color display is performed according to the magnitude of the changed luminance, and the face image is synthesized and superimposed. Therefore, it is possible to accurately grasp where the difference is.

  In the example of FIG. 11, when the pseudo color display in the selection range 63-1 before coating is compared with the pseudo color display in the selection range 63-2 immediately after coating, the selection range 63-2 just after coating has a higher luminance. It shows that the amount of change is large. The image analysis in the image analysis unit 45 may be performed by assigning a pseudo color of a predetermined color corresponding to the luminance change value in a preset pixel unit (for example, square pixels such as 1 × 1, 2 × 2, etc.). Good.

  Further, in the example of FIG. 11, the luminance change value is acquired by the image analysis unit 45. In the example of FIG. 11, one or a plurality of brightness change value measurement areas (in the example of FIG. 11, brightness change value measurement areas 64-1 and 64-2) set by the user using the input unit 41 or the like are set. For the set area, for example, a luminance change value composed of “average luminance ± standard deviation” is displayed.

  In the example of FIG. 11, the luminance change value of the luminance change value measurement region 64-1 is 93.1 ± 6.1, and the luminance change value of the luminance change value measurement region 64-2 is 71.0 ± 5. It turns out that it is 7.

<Lotion application: Example 2>
FIG. 12 is a diagram showing a luminance change before and after application of the skin lotion in “water 2”. In the example shown in FIG. 12, similarly to FIG. 11, an example in which the difference from the base image before application and immediately after application is imaged, and an example in which the difference is displayed in pseudo color within the selection range are shown. In the example of FIG. 12, in order to correct the reflection on the skin surface to some extent, after performing luminance correction, a difference image obtained by subtracting the base image from the “water 2” image was calculated. In this image, the portion where water is applied is displayed in white.

  In the example of FIG. 12, lotion is applied to the application region 62 and the user selects the predetermined selection range 63 by dragging or the like using the input means 41 such as a mouse, and an image is displayed in the selection range. The pseudo color is set by the analyzing unit 45 and the result is displayed by the image generating unit 46.

  In the example of FIG. 12, when the pseudo color display in the selection range 63-1 before coating is compared with the pseudo color display in the selection range 63-2 immediately after coating, the selection range 63-2 just after coating has a higher luminance. It is shown that the amount of change is particularly large.

  Further, in the example of FIG. 12, the luminance change values (in the example of FIG. 12, the luminance change value measurement areas 64-1 and 64-2) are set by the image analysis unit 45, and for example, “ A luminance change value consisting of “average luminance ± standard deviation” is displayed. In the example of FIG. 12, the luminance change value of the luminance change value measurement region 64-1 is 195.4 ± 7.9, and the luminance change value of the luminance change value measurement region 64-2 is 153.6 ± 6. It turns out that it is zero. That is, it can be seen that “water 2” has a larger luminance difference from the base image than “water 1”.

In the above description, the change in the brightness of the water in the selected region before and after the application of the skin lotion was calculated after some processing. Further, pseudo color display is performed according to the magnitude of the changed luminance, and the image is superimposed on the face image. In the lotion application portion, the luminance values of “water 1” and “water 2” changed greatly. “Water 1” and “Water 2” had slightly different change patterns. This is considered to be due to the fact that the detection sensitivity of water by the wavelength or the depth in the skin detected by the wavelength of water varies. (Reference paper: M Egawa, H Arimoto, T Hirao, M Takahashi, and Y Ozaki, Regional Difference of Water Content in Human Skin Studied by Diffuse-reflectance Near-infrared Spectroscopy-Consideration of Measurement Depth-, Appl Spectrosc, 60 (1 ), 24-28 (2006).
<(2) Before and after application of emulsion>
Next, skin images before and after application of the emulsion will be described with reference to the drawings. FIG. 13 is a diagram illustrating an example of a skin image before and after application of the emulsion. In the example shown in FIG. 13, images of “base”, “water 1”, “oil”, and “water 2” are shown before application, immediately after application, and 10 minutes after application.

  Here, “base” indicates an image acquired at a center wavelength of about 1300 nm ± 40 nm, “water 1” indicates an image acquired at a center wavelength of about 1500 nm ± 45 nm, and “oil” indicates 1775 nm ± 50 nm. The image acquired with the degree is “water 2”, and the image obtained with the center wavelength of about 1920 nm ± 55 nm is shown. Moreover, the area | regions 61-1 to 61-4 immediately after application | coating shown in FIG. 13 have shown the part which apply | coated the skin external preparation (in the example of FIG. 13, emulsion). Further, in FIG. 13, the above-described luminance correction is performed on all the acquired drawings.

  As shown in FIG. 13, areas 62-1 to 62-4 of the acquired image indicate application areas in “base”, “water 1”, “oil”, and “water 2”, respectively. As shown in the regions 62-1 to 62-4, when there is water or oil, it becomes black. In the example of FIG. 13, since it is an emulsion, both water and oil are changed. It can be seen that the degree of blackness is reduced after 10 minutes compared to immediately after application.

<Emulsion: Example 1>
Next, examples of the emulsion will be described. FIG. 14 is a diagram showing the luminance change before and after the emulsion application in “water 1”. The example shown in FIG. 14 shows an example in which the difference from the base image before application, immediately after application, and after 10 minutes is imaged, and an example in which the difference is displayed in pseudo color within the selection range. Further, in the example of FIG. 14, in order to correct the reflection on the skin surface to some extent, after performing luminance correction, a difference image obtained by subtracting the base image from the “water 1” image was calculated. In this image, the portion where water is applied is displayed in white.

  In the example of FIG. 14, a lotion is applied to the application region 62 and the user selects the predetermined selection range 63 by dragging or the like using the input means 41 such as a mouse, and an image is displayed in the selection range. The pseudo color is set by the analyzing unit 45 and the result is displayed by the image generating unit 46.

  In the present embodiment, the pseudo color represents a preset color or pattern according to the luminance difference. That is, pseudo color display is performed according to the magnitude of the changed luminance, and the face image is synthesized and superimposed. Therefore, it is possible to accurately grasp where the difference is.

  In the example of FIG. 14, when the pseudo color display in the selection range 63-1 before application is compared with the pseudo color display in the selection range 63-2 just after application, the selection range 63-2 just after application has the luminance. It shows that the amount of change is large. Further, when comparing the pseudo color display in the selection range 63-2 immediately after application with the pseudo color display in the selection range 63-3 after 10 minutes of application, the selection range 63-3 after 10 minutes of application has a higher luminance. It is shown that the amount of change is decreasing.

  That is, according to FIG. 14, in order to correct the reflection on the skin surface to some extent, after correcting the luminance, a difference image obtained by subtracting the base image from the water or oil image is calculated. The part to which is applied is displayed in white. Moreover, because of the emulsion, “water 1” is kept even after 10 minutes. In other words, it can be seen that it remains on the skin.

  Further, when the luminance change of “water 1” in the selected region before and after application of the lotion is calculated after performing several processes in the same manner as in the above-described example of the lotion, the luminance change value measurement region 64 immediately after application is calculated. The luminance change value of −1 is 119.0 ± 10.5, and the luminance change value of the luminance change value measurement region 64-2 is 72.7 ± 4.9. Further, the luminance change value of the luminance change value measurement region 64-3 after 10 minutes of application is 103.6 ± 8.0, and the luminance change value of the luminance change value measurement region 64-4 is 75.2 ± 4. .5.

<Emulsion: Example 2>
Next, examples of the emulsion will be described. FIG. 15 is a diagram showing a change in luminance before and after applying the emulsion in “oil”. The example shown in FIG. 15 shows an example in which the difference from the base image before application, immediately after application, and after 10 minutes is imaged, and an example in which the difference is displayed in pseudo color within the selection range. Further, in the example of FIG. 15, in order to correct the reflection on the skin surface to some extent, a difference image obtained by subtracting the base image from the “oil” image after luminance correction was calculated. In this image, the oil-applied portion is displayed in white.

  In the example of FIG. 15, lotion is applied to the application region 62 and the user selects the predetermined selection range 63 by dragging or the like using the input means 41 such as a mouse, and an image is displayed in the selection range. The pseudo color is set by the analyzing unit 45 and the result is displayed by the image generating unit 46.

  In the present embodiment, the pseudo color represents a preset color or pattern according to the luminance difference. That is, pseudo color display is performed according to the magnitude of the changed luminance, and the face image is synthesized and superimposed. Therefore, it is possible to accurately grasp where the difference is.

  In the example of FIG. 15, when the pseudo color display in the selection range 63-1 before application is compared with the pseudo color display in the selection range 63-2 immediately after application, the selection range 63-2 just after application has a higher luminance. It shows that the amount of change is large. Further, when comparing the pseudo color display in the selection range 63-2 immediately after application with the pseudo color display in the selection range 63-3 after 10 minutes of application, the selection range 63-3 after 10 minutes of application has a higher luminance. It is shown that the amount of change is decreasing.

  That is, according to FIG. 15, in order to correct the reflection on the skin surface to some extent, after correcting the luminance, a difference image obtained by subtracting the base image from the water or oil image is calculated. The part to which is applied is displayed in white. Also, because of the emulsion, the “oil” is kept even after 10 minutes. In other words, it can be seen that it remains on the skin.

  In addition, when the luminance change of the “oil” in the selected region before and after the application of the lotion is calculated after performing several processes in the same manner as in the above-described example of the lotion, the luminance change value measurement region 64- The luminance change value of 1 is 146.8 ± 10.4, and the luminance change value of the luminance change value measurement region 64-2 is 109.9 ± 5.8. In addition, the luminance change value of the luminance change value measurement region 64-3 10 minutes after application is 132.5 ± 5.8, and the luminance change value of the luminance change value measurement region 64-4 is 103.2 ± 5. It turns out that it is 0.0.

<Emulsion: Example 3>
Next, examples of the emulsion will be described. FIG. 16 is a diagram showing a luminance change before and after the emulsion application in “water 2”. The example shown in FIG. 16 shows an example in which the difference from the base image before application, immediately after application, and after 10 minutes is imaged, and an example in which the difference is displayed in pseudo color within the selection range. In the example of FIG. 16, in order to correct the reflection on the skin surface to some extent, after performing luminance correction, a difference image obtained by subtracting the base image from the “water 2” image is applied to the application region 62 in the example of FIG. 16. Then, the user applies a lotion and drags the input means 41 such as a mouse to select a predetermined selection range 63, and a pseudo color is set by the image analysis means 45 in the selection range. The result is displayed by the generation means 46.

  In the present embodiment, the pseudo color represents a preset color or pattern according to the luminance difference. That is, pseudo color display is performed according to the magnitude of the changed luminance, and the face image is synthesized and superimposed. Therefore, it is possible to accurately grasp where the difference is.

  In the example of FIG. 16, when the pseudo color display in the selection range 63-1 before application is compared with the pseudo color display in the selection range 63-2 immediately after application, the selection range 63-2 just after application has the brightness in the selection range 63-2. It shows that the amount of change is large. Further, when comparing the pseudo color display in the selection range 63-2 immediately after application with the pseudo color display in the selection range 63-3 after 10 minutes of application, the selection range 63-3 after 10 minutes of application has a higher luminance. It is shown that the amount of change is decreasing.

  That is, according to FIG. 16, in order to correct the reflection on the skin surface to some extent, after correcting the luminance, a difference image obtained by subtracting the base image from the water or oil image is calculated. The part to which is applied is displayed in white. Moreover, because of the emulsion, “water 2” is maintained even after 10 minutes. In other words, it can be seen that it remains on the skin.

  Further, when the luminance change of “water 2” in the selected region before and after the application of the lotion is calculated after performing some processes in the same manner as in the above-described example of the lotion, the luminance change value measurement region 64 immediately after application is calculated. The luminance change value of −1 is 194.3 ± 14.8, and the luminance change value of the luminance change value measurement region 64-2 is 139.0 ± 4.9. In addition, the luminance change value of the luminance change value measurement region 64-3 10 minutes after application is 184.5 ± 10.6, and the luminance change value of the luminance change value measurement region 64-4 is 139.2 ± 5. It turns out that it is 0.0.

  Immediately after application, portions where “oil”, “water 1”, and “water 2” are applied are changed. Further, the change was “water 2”> “water 1”, but this factor may be imaging sensitivity and imaging depth, as described above. In addition, after 10 minutes of application, “water 1”, “water 2”, and “oil” are all decreased from immediately after, but it is understood that they still exist sufficiently.

  In addition, when looking at the areas other than the application site, “oil” has almost no change, whereas “water 2” has 10 minutes more water than before application when the brightness value changes. ing. The application was performed 10 minutes after the face washes, but there was a possibility that the process of recovering the amount of water lost by the face was recovered by the function of the skin originally possessed.

  As described above, when images are combined in a plurality of near infrared regions, simultaneous analysis can be performed on a sample that wants to follow changes in both water and oil, such as an emulsion.

<(3) Before and after application of hair treatment>
Next, skin images before and after application of hair treatment will be described with reference to the drawings. FIG. 17 is a diagram showing an example of hair before and after application of a hair treatment. In the example of FIG. 17, images of “base”, “water 1”, “oil”, and “water 2” before and immediately after application and after 10 minutes have elapsed are shown.

  Here, “base” indicates an image acquired with a center wavelength of about 1300 nm ± 40 nm, “water 1” indicates an image acquired with a center wavelength of about 1500 nm ± 45 nm, and “water 2” indicates a center wavelength. Is an image acquired at about 1920 nm ± 55 nm. Moreover, the area | regions 61-1 to 61-3 immediately after application | coating shown in FIG. 17 have shown the part which apply | coated the skin external preparation (in the example of FIG. 17, hair treatment). In FIG. 17, the above-described luminance correction is performed on all the acquired drawings.

  As shown in FIG. 17, areas 62-1 to 62-3 of the acquired image indicate application areas in “base”, “water 1”, and “water 2”, respectively. It turns black when there is water as shown in ~ 62-3.

  That is, in FIG. 17, the above-described lighting device 11 was photographed with the back of the head. In the example of FIG. 17, it becomes black when there is water. Here, unlike the skin, hair originally appears white because of its very low water content. The reason why there is a black part immediately after the application of the base image is that when the water-based treatment is sprayed, the sprayed part becomes a bundle, and the hair is bundled and floats.

  In the “water 1” and “water 2” images shown in FIG. 17, the sprayed portion appears black due to water absorption. Although “Water 1” and “Water 2” are captured differently, it is thought that there is a difference in water detection sensitivity or imaging depth depending on the wavelength.

<Second Embodiment>
Next, a second embodiment will be described. In the second embodiment, the contents presented in the above-described embodiments are shown in a more easily understandable manner for the user to display a screen presented to the user.

  Here, FIG. 18 is a figure which shows an example of the brightness | luminance change before and after the lotion application in other embodiment. FIG. 19 is a diagram showing an example of the selection range pseudo color display corresponding to FIG.

  FIG. 18 and FIG. 19 show changes (“Water 1”-“Base”), (“Oil”-“Base”), (“Water 2”-“Base”) immediately after application, before application. ing. In addition, the lotion is shown in the application area 71 of the external preparation for skin. Also, the color of the difference image of the luminance change is shown differently for “water 1” and “water 2” and for “oil”. FIG. 18 shows that the color is dark in the application area 71 and the difference value is large.

  In FIG. 19, the selection range 72 to which the above-described pseudo color is assigned and the luminance change value measurement areas 73-1 to 73-3 under each condition are shown. In the case of “water 1” − “base” in the change from before application immediately after application, the luminance change value of the luminance change value measurement region 73-1 is 185.6 ± 22.7, and the luminance change value measurement region It can be seen that the luminance change value of 73-2 is 205.7 ± 17.9, and the luminance change value of the luminance change value measurement region 73-3 is 238.7 ± 16.0. In the case of “oil”-“base”, the luminance change value of the luminance change value measurement region 73-1 is 213.7 ± 22.4, and the luminance change value of the luminance change value measurement region 73-2 is It is 234.8 ± 16.5, and it can be seen that the luminance change value of the luminance change value measurement region 73-3 is 254.0 ± 5.2. Further, in the case of “water 2” − “base”, the luminance change value of the luminance change value measurement region 73-1 is 138.4 ± 21.2, and the luminance change value of the luminance change value measurement region 73-2 is 193.0 ± 21.5, and it can be seen that the luminance change value of the luminance change value measurement region 73-3 is 254.9 ± 1.6.

  In FIG. 19, it can be seen that “oil” has less change in the change from before application, and “water 1” and “water 2” have a larger change. Further, it can be seen that “water 2” has a larger change than “water 1”.

  Here, FIG. 20 is a figure which shows an example of the brightness | luminance change before and behind the emulsion coating in other embodiment. FIG. 21 is a diagram showing an example of the selection range pseudo color display corresponding to FIG.

  20 and FIG. 21 show changes from before application immediately after application and 10 minutes after application ("water 1"-"base"), ("oil"-"base"), ("water 2"-" Base "). In addition, the lotion is shown in the application area 71 of the external preparation for skin. Also, the color of the difference image of the luminance change is shown differently for “water 1” and “water 2” and for “oil”. FIG. 20 shows that the color is darkly displayed in the application region 71 and the difference value is large. Further, the same luminance change is observed in the application region even after 10 minutes of application.

  FIG. 21 shows the above-described pseudo color selection range 72 and luminance change value measurement regions 73-4 and 73-5 under each condition. In the case of “water 1”-“base” in the change from before application immediately after application, the luminance change value of the luminance change value measurement region 73-4 is 134.0 ± 19.4, and the luminance change value measurement region It can be seen that the luminance change value of 73-5 is 247.4 ± 9.0. Further, in the change from before the application 10 minutes after the application, the luminance change value of the luminance change value measurement region 73-4 is 128.4 ± 30.3, and the luminance change of the luminance change value measurement region 73-5. It can be seen that the value is 233.1 ± 12.1.

  Also, in the change from before application immediately after application, in the case of “oil”-“base”, the luminance change value of the luminance change value measurement region 73-4 is 153.1 ± 24.9, and the luminance change value measurement. It can be seen that the luminance change value of the region 73-5 is 229.4 ± 15.9. Further, in the change from before the application 10 minutes after the application, the luminance change value of the luminance change value measurement region 73-4 is 143.6 ± 27.3, and the luminance change of the luminance change value measurement region 73-5. It can be seen that the value is 226.5 ± 15.9.

  Further, in the case of “water 2” − “base” in the change from before application immediately after application, the luminance change value of the luminance change value measurement region 73-4 is 69.5 ± 31.2, and the luminance change value It can be seen that the luminance change value of the measurement region 73-5 is 222.8 ± 15.3. Further, in the change from before the application 10 minutes after the application, the luminance change value of the luminance change value measurement region 73-4 is 79.8 ± 27.1, and the luminance change of the luminance change value measurement region 73-5. It can be seen that the value is 179.2 ± 17.0.

  As described above, by presenting the brightness change value for the brightness change value measurement area specified by the user, the change value for an arbitrary place can be easily presented, and the brightness difference can be easily clarified by a numerical value. Can grasp.

  In addition, since the above-mentioned image can be shown to a subject or a user in real time, makeup counseling can be performed while applying a skin external preparation.

  Furthermore, the acquired images can be managed and accumulated for each subject, statistical processing can be performed using a certain collected data, and evaluation over time can be performed. Moreover, skin, hair, etc. can be analyzed using 4 wavelengths.

  As described above, according to the present invention, an image in the near infrared region can be taken with high accuracy. Therefore, skin analysis can be performed with high accuracy using an image in the near infrared region. In addition, according to the present invention, examination of the presence state of water in the base, imaging of the difference in water state due to prescription, enlarged skin image (applied state of water in the cuticle skin groove), enlarged hair image, Analysis such as imaging of nail moisture is also possible.

  Further, according to the present invention, it is possible to perform counseling by a counselor on how to apply makeup for each position or user for applying makeup, and it can also be widely used for evaluation of beauty methods.

  Specifically, according to the present invention, for example, a cleaning effect evaluation of a cleaning material by evaluating skin exposure from a moisture distribution state analysis using a near-infrared image, and a moisture distribution state using a near-infrared image It can be applied to makeup cosmetics application state evaluation such as a foundation (FD) adhesion state evaluation method by evaluating skin exposure from analysis.

  Furthermore, according to the present invention, as a new skin quality classification method by analyzing the distribution of specific components using a near-infrared image, a skin quality evaluation method using moisture and oil content distribution and a near-infrared image are used. It can be applied in a wide range of fields such as a skin quality evaluation program based on distribution state analysis, a moisturizing effect evaluation method for cleaning materials, and a moisturizing effect evaluation method for cleaning materials based on moisture distribution state analysis using near-infrared images.

  The preferred embodiments of the present invention have been described in detail above, but the present invention is not limited to such specific embodiments, and various modifications, within the scope of the gist of the present invention described in the claims, It can be changed.

DESCRIPTION OF SYMBOLS 10 Illumination system 11 Illumination device 12 Image analysis device 13 Cable 21 Dome (housing)
Reference Signs List 22 Light Source 23 Jaw Mount Member 24 Imaging Device 25 Slide Rail 26 Camera Base 30 Light Source Shading Plate 31 Lens Front Shading Plate 32 Base 33 Forehead Holding Member 34, 39 Opening 35 First Filter 36 Second Filter 37 Third Filter 38 Filter slide mechanism 40 Color chart 41 Input means 42 Output means 43 Storage means 44 Captured image acquisition means 45 Image analysis means 46 Image generation means 47 Control means 51 Input device 52 Output device 53 Drive device 54 Auxiliary storage device 55 Memory device 56 CPU
57 Network connection device 58 Recording medium 61 Area 62, 71 Application area 63, 72 Selection range 64, 73 Brightness change value measurement area

Claims (10)

An illumination device for photographing a face image of a subject in a plurality of different near-infrared regions by an imaging means,
A housing that accommodates the entire face of the subject and has a substantially spherical space;
At least two light sources that are arranged at one or more positions on the left and right sides of the subject on the spherical surface and irradiate light into the space of the housing;
Imaging means for photographing the entire part of the face irradiated with light from the light source;
Corresponding to a first filter for blocking ultraviolet rays and infrared rays installed in front of the light source, a second filter for adjusting the amount of light installed in front of the lens of the imaging means, and the plurality of different near infrared regions And a third filter for performing bandpass filtering.   The lighting device according to claim 1, further comprising a first light shielding plate inside the housing so that light from the light source is not directly irradiated onto the subject.   The lighting device according to claim 1, further comprising a second light shielding plate in front of the lens of the imaging unit.   4. The lighting device according to claim 1, further comprising a slide mechanism for changing types of the second filter and the third filter. 5.   The lighting device according to any one of claims 1 to 4, wherein a predetermined paint is repeatedly applied to the inside of the housing.   The illumination device according to any one of claims 1 to 5, wherein the light source is a halogen light source or an LED for photographing a near-infrared region. An image analysis apparatus for analyzing the skin of a subject using face images of the subject in a plurality of different near-infrared regions photographed by the illumination device according to claim 1,
Image acquisition means for acquiring the face image before and after applying a skin external preparation to the subject;
Luminance correction means for performing luminance correction on the image acquired by the image acquisition means;
A difference amount acquisition means for acquiring a difference amount between images before and after applying the external preparation for skin obtained by the brightness correction means for each of the plurality of different near infrared regions;
Analysis means for analyzing the skin of the subject based on the difference amount obtained by the difference amount acquisition means;
An image analysis apparatus comprising: a screen generation unit that generates a screen for displaying the analysis result obtained by the analysis unit.   8. The image according to claim 7, wherein the plurality of near-infrared regions are at least two bands among 1100 to 1360 nm, 1300 to 1640 nm, 1860 to 2200 nm, 1700 to 1860 nm, and 2230 to 2400 nm. Analysis device. The screen generation means includes
9. The screen according to claim 7 or 8, wherein a screen highlighted for each predetermined pixel is generated with a preset color or pattern based on the magnitude of the difference amount obtained by the difference amount acquisition means. Image analysis device. The analysis means includes
10. The luminance change value for a predetermined region in the screen set by a user is calculated from the analysis result screen obtained by the screen generation unit. 10. Image analysis device.