JP2013101109A - Lighting system and image acquisition device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To accurately photograph an image in a near-infrared area.SOLUTION: In a lighting system for photographing an object portion of a subject by a predetermined near-infrared area, the above problem is solved by being provided with: a plurality of light sources which irradiate the object portion with light in the predetermined near-infrared area from an opening; and imaging means for photographing the object portion irradiated by the light sources, and being provided with: a first filter which removes surface reflected light from the object portion; a second filter for adjusting light volume from the light sources; and a third filter which makes the light pass through only a predetermined wavelength area on light paths, from the light sources to the imaging means.

Description

  The present invention relates to an illumination device and an image acquisition device, and more particularly to an illumination device and an image acquisition device for capturing an image in the near infrared region with high accuracy.

  2. Description of the Related Art Conventionally, an apparatus for observing skin has been used as a sales promotion tool for selling counseling according to a customer's skin condition and optimal cosmetics, for example, in the beauty field. In such a conventional skin observation device, a visible light illumination device is mainly used, and the device is applied to an arbitrary portion to be enlarged and observed, thereby obtaining and observing the shape and color of the customer's skin. Technology exists (for example, refer to Patent Document 1). Conventionally, a light source using ultraviolet light has been proposed (see, for example, Patent Document 2).

  Conventionally, a technique for visualizing moisturizing liquid applied to the face surface using two near-infrared spectroscopic images obtained by a near-infrared camera in order to visualize the change in moisture on the face has been disclosed (for example, Non-patent document 1).

  Here, the technique disclosed in Non-Patent Document 1 is a measurement of a face using an InGaAs near-infrared camera (for example, Sensors Unlimited, Inc. SU320M-1.7RT) having sensitivity in a wavelength region of 900 to 1700 nm. This is converted into a differential absorbance image using two near-infrared spectral images acquired by the measurement, so that only the moisturizing liquid applied to the face can be visualized.

  In addition, conventionally, a technique for discriminating the amount of skin moisture using near infrared has also been disclosed (see, for example, Patent Document 3). The technique shown in Patent Document 3 includes a step of obtaining the reflection intensity at a plurality of points on the skin with respect to the near infrared wavelength region of the wavelength region from 1050 to 1650 nm, and the skin moisture amount and the near infrared wavelength region prepared in advance. Substituting the reflection intensity obtained in the above step into the prediction formula indicating the relationship with the reflection intensity to obtain a plurality of skin moisture amounts, and distinguishing the skin moisture distribution from the obtained plurality of skin moisture amounts It has been shown.

JP 2010-88599 A JP 2010-148685 A JP 2010-25622 A

Hiroaki Iwasaki et al., “Visualization of moisture change in face using two near-infrared spectral images”, The Optical Society of Japan (Applied Physics Society), Optics Japan 2005 Tokyo, November 23-25, 2005

  In the above-described conventional technology, as shown in Patent Literature 1 and Patent Literature 2 and the like, as shown in a technique relating to a skin observation apparatus using a visible light or ultraviolet light source, Patent Literature 3 and Non-Patent Literature 1 and the like. Shows a technique for obtaining an image in the near-infrared region of the entire face.

  Here, in order to perform appropriate counseling for the customer's skin condition, etc., for example, while observing the shape of the skin in the state of being close to the observation target part and enlarged, the moisture and oil content of the skin are also observed. Although it is preferable to analyze, an illumination device and an image acquisition device specialized for a necessary near-infrared region at the time of proximity are not disclosed.

  The present invention has been made in view of the above-described problems, and an object thereof is to provide an illumination device and an image acquisition device for capturing an image in the near infrared region with high accuracy. Specifically, an object of the present invention is to provide, for example, an illumination device and an image acquisition device for enlarging and photographing an image in the near infrared region with high accuracy.

  In order to solve the above-described problems, the present invention employs means for solving the problems having the following characteristics.

  The present invention provides a lighting device for photographing a target portion of a subject in a predetermined near infrared region, a plurality of light sources that irradiate the target portion with light from the predetermined near infrared region through an opening, A first filter that removes surface reflected light from the target part on an optical path from the light source to the imaging part, and an imaging unit that images the target part irradiated by the plurality of light sources; It has a 2nd filter for adjusting the light quantity from the said light source, and a 3rd filter which allows only a preset wavelength range to pass through.

  According to another aspect of the present invention, there is provided an image analysis device that performs analysis using an image of a target portion of a subject in a predetermined near-infrared region captured by the above-described lighting device, and an image acquisition unit that acquires a local image of the subject. The image analysis means for analyzing the state of the target region included in the image obtained by the image acquisition means, and the screen generation means for generating a screen for displaying the analysis result obtained by the image analysis means. It is characterized by.

  According to the present invention, an image in the near infrared region can be taken with high accuracy.

It is a figure which shows an example of schematic structure of the skin observation system in this embodiment. It is a figure which shows the example of arrangement | positioning of the light source in this embodiment. It is a figure which shows an example of a function structure of the image analysis apparatus in this embodiment. It is a figure which shows an example of the hardware constitutions which can implement | achieve the image analysis process in this embodiment. It is a figure for demonstrating an example of the image of the analysis result in this embodiment. It is a figure for demonstrating the predominance of evaluating the image obtained in this embodiment. It is a figure which shows an example of the moisture data obtained in this embodiment. It is a figure which shows an example (the 1) of the skin state before and behind sample application. It is a figure which shows an example (the 2) of the skin state before and behind sample application. It is a figure which shows the other example of application in this embodiment.

<About the present invention>
The present invention, for example, uses a near-infrared camera capable of photographing up to a wavelength range of about 800 to 2500 nm, and is desired to reach the skin, hair, nails, etc. of the face, hands, arms, feet, etc. of a subject such as a customer. The present invention relates to an illumination device for obtaining an enlarged image of each part of a subject with high accuracy, and an image acquisition device for obtaining an image photographed using the illumination device.

  Hereinafter, preferred embodiments of the illumination device and the image acquisition device according to the present invention will be described with reference to the drawings. In the following example, an example of photographing facial skin is shown, but the present invention is not limited to this. For example, skin of hands and arms, hair, nails and other biological samples, The present invention can be applied to anything for evaluating the moisture and oil content of model samples such as skin substitutes (for example, pig skin, artificial skin, urethane).

<Skin observation system: schematic configuration example>
First, a schematic configuration example of the skin observation system in the present embodiment will be described with reference to the drawings. In the following example, an example of photographing facial skin is shown. However, the present invention is not limited to this. For example, skin of hands and arms, substitute skin (for example, pig skin, artificial skin) , Urethane), hair, nails, and the like, and can be applied to all things for evaluating moisture and oil.

  FIG. 1 is a diagram illustrating an example of a schematic configuration of a skin observation system in the present embodiment. In addition, Fig.1 (a) has shown the schematic block diagram of the skin observation system. The skin observation system 10 illustrated in FIG. 1A includes an image acquisition device 11 and an image analysis device 12 in brief. The image acquisition device 11 and the image analysis device 12 are connected in a state where data can be transmitted and received by wire or wireless. FIG. 1B shows details of the image acquisition device 12. Further, FIG. 1C shows an example of a diffuse reflection unit provided in the image acquisition device 12.

  The image acquisition device 11 is brought close to or in contact with a skin (for example, a cheek) on which a subject (user) who is an observation target is to be observed, and an enlarged image having a preset enlargement ratio for the portion (local part). Take a picture. Note that proximity means that the object is in a position that is very close to the observation object but is not in contact with the observation object (for example, the distance interval is about several millimeters). The captured image is output to the image analysis device 12.

  The image analysis device 12 performs power ON / OFF control and light source setting in the image acquisition device 11, stores an image acquired from the image acquisition device 11, and displays it on a user, a counselor, or the like.

  Here, the image acquisition device 11 in the present embodiment will be described more specifically. As shown in FIG. 1B, the illumination device 20 and a near-infrared digital camera 30 (hereinafter referred to as “camera”) as imaging means. 30 ”). The illuminating device 20 is a diffuse reflection unit 21, an opening 22 provided in the diffuse reflection unit 21, a light source 23, a transmission lens 24, a polarization filter 25 as a first filter, and a second filter. An ND (Neutral Density) filter 26, a band-pass filter 27 as a third filter, an ultraviolet cut filter 28, and an infrared cut filter 29 are included.

  The diffuse reflection unit 21 is configured such that light emitted from the light source 23 is diffused inside the illumination device 20, and thus the light source can be uniformly applied to the object. In addition, although the diffuse reflection part 21-1 shown in FIG.1 (b) becomes a housing | casing which has a dome shape shape in which space was formed, for example in this invention, it is not limited to this. For example, as shown in FIG.1 (c), the cup-shaped diffuse reflection part 21-2 may be sufficient.

  That is, the diffuse reflection unit 21 is configured so that the light from the light source 23 can be efficiently diffused and the entire inside of the housing can be photographed brightly according to the arrangement and number of the light sources 23, the type of the light source, and the like. Moreover, the inner surface of the diffuse reflection part 21 may be colored in a brighter color (for example, white) or may have gloss or the like so that it can be easily reflected. Furthermore, in order to make it easy to diffusely reflect, the inner surface of the diffuse reflection portion 21 may be formed with, for example, fine irregularities and pear ground.

  The opening 22 is a portion (region) for acquiring a skin image from the opening 22 in proximity to or in contact with a shooting target portion such as the cheek of the user 1. The opening 22 may be provided with a dedicated lens (for example, a magnifying lens), or may be opened.

  The light source 23 irradiates light having a predetermined wavelength necessary for photographing an object such as skin. In the present embodiment, as the light source 23, for example, at least one light source among light sources including many wavelengths in the near infrared region (halogen, LED (Light Emitting Diode), Super Continuous (SC) light source, etc.) can be used. However, the present invention is not limited to this. For example, in the present embodiment, the light source 23 may be a combination of a plurality of light sources among various light sources such as the above-described halogen, LED, and SC light sources. Further, in the present embodiment, when the light source 23 is an SC light source or a halogen, introduction with an optical fiber is also possible.

  In the present embodiment, for example, since the near-infrared camera 30 capable of photographing up to a wavelength region of about 800 to 2500 nm is used, the light source wavelength is also used in an arbitrary range of the above wavelength region.

  The transmission lens 24 is, for example, a lens that transmits light in a predetermined near infrared region. Further, the transmissive lens 24 can also enlarge an object to be photographed such as skin at a predetermined magnification. In addition, the magnification adjustment such as enlargement can be adjusted by installing a close-up lens in the opening 22, for example. In addition, since the magnification in the present embodiment is targeted from a wide range of skin surfaces to one hair, etc., for example, enlargement of about 10 to 800 times is possible, but the present invention is limited to this. is not.

  The polarizing filter 25 is a removal filter (first filter) that removes surface reflected light from the skin itself, which is the imaging target region. The ND filter 26 is a light amount adjustment filter (second filter) for adjusting the light amount by a combination of the light source 23 and the lens system. Note that the ND filter is used for all types of light sources in the present embodiment.

  The bandpass filter 27 is a pass filter (third filter) that passes only a specific wavelength region set in advance in order to acquire an image of only a specific wavelength region. In the present embodiment, the use of the bandpass filter 27 can limit the wavelength characteristics and increase the accuracy. The band-pass filter 27 is different depending on the purpose, for example, and uses a plurality of wavelength regions or a variable wavelength. The band-pass filter 27 is used when the light source 23 is, for example, a halogen light source or an SC light source, but may be used in the case of an LED. In addition, the structure of each filter mentioned above is an example, For example, the structure can be changed arbitrarily by the combination etc. of the characteristic of a light source and a lens.

  Here, the observation target in the present embodiment is divided into two types, that is, a biological system and a model system as described above, and the difference in wavelength region is, for example, moisture or oil on the observation target rather than the observation target itself. It depends on the substance to be analyzed. Therefore, for example, about 1460 nm or about 1920 nm for the observation of moisture, and about 1750 nm or about 2230 to 2400 nm for the oil content are passed through the wavelength region described above, but this is used in the present embodiment. The wavelength region is not limited to this.

  The ultraviolet cut filter 28 and the infrared cut filter 29 remove optical noise and remove the far-infrared wavelength region that becomes heat affecting the observation site. Specifically, the ultraviolet cut filter 28 is a filter for cutting an ultraviolet region from the light source 23. The infrared cut filter 29 is a filter for cutting the infrared region from the light source 23. Further, the ultraviolet cut filter 28 and the infrared cut filter 29 may be integrally formed as a fourth filter. The ultraviolet cut filter 28 and the infrared cut filter 29 described above are used, for example, when a halogen light source is used as the light source 23.

  Here, in the example shown in FIG. 1B, the polarizing filter 25, the ND filter 26, and the band pass filter 27 are the polarizing filter 25-1, the ND filter 26-1, and the band pass filter 27-1 of the optical system. A polarizing filter 25-2 of the light source system, an ND filter 26-2, and a bandpass filter 27-2. It suffices that at least one lens is disposed on the optical path to the lens portion of the infrared digital camera 30 (for example, the light source 23 → the object to be photographed → the camera 30).

As shown in FIG. 1A, the size of the lighting device 20 is, for example, a width w ₁ of about 30 to 150 mm and a width w ₂ of about 20 to 70 mm. It is not limited to this.

  The near-infrared digital camera 30 is a camera having a near-infrared imaging device (for example, InGas). The near-infrared digital camera 30 in the present embodiment can take an image in a wavelength region of 800 to 2500 nm, for example. Note that the near-infrared digital camera 30 can shoot not only still images but also moving images.

  As described above, in the present embodiment, the lighting device 20 is used to approach or abut the subject's skin (for example, hair, nails, or artificial skin), accommodate that portion (local part), and the diffuse reflector 21. A plurality of light sources that irradiate light into the space of the housing, one or a plurality of them being disposed at the positions of the left and right objects of the subject in the housing in which the space is formed by the inner surface (diffuse reflecting surface) of the diffuse reflector 21 23 and a camera 30 that is an imaging means for enlarging and photographing the portion of the subject irradiated with light from the light source.

  In the present embodiment, when a predetermined image is acquired using a predetermined near-infrared region, for example, water absorption characteristics near about 1460 nm, oil absorption characteristics near about 1750 nm, strong water near about 1920 nm At least one image is acquired among the images of the subject with respect to the absorption characteristics and the strong absorption characteristics of a plurality of oils in the vicinity of about 2230 to 2400 nm.

  That is, in the present embodiment, by acquiring an image using at least one wavelength region among the above-described wavelength regions, detailed analysis or evaluation of skin or the like can be performed on the acquired image. Therefore, in this embodiment, highly accurate skin observation can be realized.

  Further, in the illumination device 20 according to the present embodiment, the first polarizing filter that prevents reflection on the surface, which becomes noise, installed in the lens of the imaging unit, the second filter that adjusts the amount of light on the surface, and the plurality of different nearby points. And a third filter that performs band-pass filtering corresponding to the infrared region. Furthermore, in this embodiment, when the light source 23 is halogen, it has the 4th filter which interrupts | blocks the ultraviolet-ray and infrared rays which are installed in front of the light source 23. FIG.

  Furthermore, in this embodiment, a combination with a light source specialized in a specific wavelength region can be used. In addition, the illumination device 20 may be of a type in which a normal halogen light source is introduced directly or with a predetermined cable such as an optical fiber, or a type in which a plurality of near infrared LEDs are incorporated. Is preferably an LED type. This is because, in the LED type, the light source itself is specialized in the near infrared, and in some cases (for example, if it is water), it is considered that skin observation is possible even with a configuration without the band-pass filter 27.

  In the example shown in FIG. 1, the image acquisition device 11 and the image analysis device 12 are provided separately. However, the present invention is not limited to this. For example, the configuration of the image analysis device 12 is not limited thereto. A part or all of them may be included in the image acquisition device 11 side and may be integrated. Therefore, for example, a screen for displaying an image may be provided directly in the image acquisition device 11.

<Example of arrangement of light source 23 in this embodiment>
Next, an arrangement example of light sources in the present embodiment will be described with reference to the drawings. FIG. 2 is a diagram illustrating an arrangement example of light sources in the present embodiment. In the present embodiment, an arrangement example as shown in FIGS. 2A to 2C can be used, and an arrangement obtained by combining a plurality of these arrangement examples can also be applied.

  FIG. 2A shows an example in which a plurality of light sources 23 are arranged at different distances from the center of the lens of the camera 30, for example. Specifically, as shown in FIG. 2A, a light source 23-1 arranged at equal intervals in a circle having a small distance (radius) from the center and a circle having a larger radius than the light source 23-1. And light sources 23-2 arranged at equal intervals. Note that the light sources 23-1 and 23-2 are alternately arranged. Thereby, it becomes difficult to make a shadow due to interference of the light source, and it is possible to obtain an optimum state with respect to the form of an observation target (photographing target) such as skin. Note that the arrangement of the light sources shown in FIG. 2A is such that, for example, if the object to be observed is skin or the like, the small circular light sources 23-1 and It is possible to switch between using one of the large circular light sources 23-2 or using both light sources 23-1, 23-2.

  FIG. 2B shows an example in which a plurality of light sources 23 having different output wavelengths are arranged. Specifically, as shown in FIG. 2B, a light source 23-3 having a first output wavelength, and a light source 23-4 having a second output wavelength different from the wavelength region of the first output wavelength Are alternately arranged in the same circle. Note that the wavelength region of the first output wavelength and the wavelength region of the second output wavelength may partially overlap, or may be wavelength regions that do not overlap each other.

  Thereby, in this embodiment, the wavelength can be switched quickly and easily according to the observation purpose using either one or both of the light sources 23-3 and 23-4. Furthermore, in this embodiment, by using both the light sources 23-3 and 23-4, it is possible to observe a skin or the like by irradiating a light source in a long region (wider wavelength range). In the example of FIG. 2B, two types of light sources are used. However, the present invention is not limited to this. For example, three or more types of light sources having different wavelength regions may be used.

Further, in the example of FIG. 2C, an example is shown in which the light sources 23 are arranged in a plurality of circles at different angles. Specifically, as shown in FIG. 2C, the light source 23-5 is arranged in a circle with a small radius from the center, and the circle has a larger radius than the circumference where the light source 23-5 is arranged. And a disposed light source 23-6. Further, in the example of FIG. 2 (c), it is arranged at an angle the larger the angle theta ₂ of the light sources 23-6 than the angle theta ₁ facing the center of the light source 23-5. Thereby, it becomes difficult to make a shadow due to interference of the light source, and an optimum state can be obtained for the form of the observation target such as the skin.
In the example of FIG. 2C, one of the light source 23-5 and the light source 23-6 (the light source 23-5 in the example of FIG. 2C) is the subject to be observed than the other. You may arrange | position close to the site | part side.

  In addition, in this embodiment, it can also be used combining the arrangement | positioning of Fig.2 (a)-(c) mentioned above. 2A to 2C described above show an example in which a plurality of light sources are arranged in a circle. However, the present invention is not limited to this. For example, a camera lens is used. Light sources may be arranged at predetermined intervals on an outer shape such as a regular hexagon or a regular octagon as an axis.

<Functional Configuration Example of Image Analysis Device 12 in Present Embodiment>
Next, a functional configuration example of the image analysis device 12 in the present embodiment will be described with reference to the drawings. FIG. 3 is a diagram illustrating an example of a functional configuration of the image analysis apparatus according to the present embodiment. 3 includes an input unit 41, an output unit 42, a storage unit 43, a captured image acquisition unit 44, an image analysis unit 45, an image generation unit 46, a transmission / reception unit 47, and a control. And means 48.

  The input unit 41 accepts input such as start / end of various instructions such as an image acquisition instruction, an image analysis instruction, an image generation instruction, and transmission / reception from the user. Note that the input unit 41 includes, for example, a keyboard and a pointing device such as a mouse. The input unit 41 has a function of inputting, for example, an image of an observation target portion of a subject that has already been captured by the image acquisition device 11.

  The output means 42 displays / outputs the contents input by the input means 41 and the contents executed based on the input contents. Note that the output means 42 includes a display, a speaker, and the like. Further, the output unit 42 may have a function of a printer or the like. In that case, the image analysis result or the like can be printed on a print medium such as paper and provided to a subject or a counselor.

  Here, the input means 41 and the output means 42 described above may be integrated input / output means such as a touch panel. In this case, the user's finger or a pen-type input device is used. An input can be performed by touching a predetermined position on the screen.

  The accumulating unit 43 accumulates various data such as a photographed image obtained by the photographed image acquiring unit 44 and the like, an image analysis result by the image analyzing unit 45, and a generated image generated by the image generating unit 46. Further, the storage means 43 can arbitrarily read out various data stored as necessary.

  The captured image acquisition unit 44 acquires an observation target image (enlarged image) of the subject captured by the camera 30 in the image acquisition device 11. The captured image acquisition unit 44 illuminates the subject with the illumination device 20 and captures the target portion with the camera 30, for example, depending on the content of the image to be captured, the type and position of the light source 23 to be used, The number or the like can be set, or the amount of light emitted from the light source 23 can be adjusted.

  The captured image acquisition unit 44 uses the above-described filters in combination with the camera 30 to acquire a predetermined near-infrared region image filtered by the predetermined bandpass filter 27. Can be generated and output to the image acquisition apparatus 11. The image acquired by the captured image acquisition unit 44 is stored in the storage unit 43.

  The image analysis unit 45 analyzes the state of the observation target part included in the image obtained by the captured image acquisition unit 44, for example. Specifically, the image analysis unit 45 analyzes, for example, the luminance value for displaying the absorption due to moisture and oil in the near infrared region as the luminance value in the acquired image. At this time, the image analysis unit 45 may perform image processing such as luminance correction. Thereby, a homogenized image can be acquired. Further, the image analysis unit 45 analyzes, for example, a portion with a lot of moisture and a portion with a small amount of moisture and a dry portion on the basis of the average value of the entire luminance calculation values.

  Further, the image analysis means 45 can also calculate a statistic at an arbitrary part included in the image. Specifically, the image analysis unit 45 specifies a region (part) to be observed by the user or the like using the input unit 41 or the like for a plurality of measurement result images. Analyzes are performed, and average values and standard deviations of luminance are calculated to obtain quantitative data. The designated area may be one for one image or plural.

  Further, the image analysis means 45 analyzes, for example, luminance change before and after application of a skin external preparation such as skin lotion or emulsion (before and after continuous use), calculation of a luminance change value, and designation by the user for the input image. Analysis of pseudo color setting corresponding to the luminance difference with respect to the region is performed.

  Further, the image analysis means 45 can also analyze the skin from these images using time-series images such as before application, immediately after application, and after application. Further, in the present embodiment, the image analyzed by the image analysis unit 45 may be analyzed in real time each time while being captured from the image acquisition device 11, or analyzed using an image stored in the storage unit 43 in advance. May be.

  Note that the image analyzed by the image analysis unit 45 is a skin image such as a cheek or forehead of a subject, for example, and skin image analysis can also be performed on images of arms, hands, feet, or the like. Further, the image analysis means 45 can analyze a portion containing moisture and oil, such as hair and nails, and also performs the same analysis on artificially made skin, hair, nails and the like. be able to.

  The image generation unit 46 generates an image to be presented to the user based on the result analyzed by the image analysis unit 45. The image generation unit 46 may display the image acquired by the captured image acquisition unit 44 as it is, or synthesizes the original image using a pseudo color or the like corresponding to the luminance difference analyzed by the image analysis unit 45. Then, the synthesized image may be displayed on the screen. Note that the image generation unit 46 performs processing such as enlargement of the luminance region, calculation of the difference image, luminance inversion, and the like, for example, in order to display the composite image on the screen so that it can be easily seen by the user. It can also be made. Note that examples of images obtained by this embodiment will be described later.

  The transmission / reception means 47 is for realizing images (photographed images, etc.) from an external device that can be connected using a communication network represented by the Internet or the like, a LAN (Local Area Network), etc. It is an interface for acquiring the execution program etc. The transmission / reception means 47 can transmit various information generated in the image analysis device 10 to an external device.

  The control unit 48 controls the entire components of the image analysis device 12. Specifically, the control unit 48 performs each control such as a captured image acquisition process, an image analysis process, and an image generation process based on an instruction from the input unit 41 by a user or the like, for example.

<Image Analysis Device 12: Hardware Configuration>
Here, in the image analysis apparatus 12 described above, an execution program (image analysis program) is generated as software that can cause a computer (hardware) to execute each function, and the program is stored in, for example, a general-purpose personal computer or server. By installing the execution program, analysis using an image in a predetermined near-infrared region in the present embodiment can be realized.

  FIG. 4 is a diagram illustrating an example of a hardware configuration capable of realizing the image analysis processing in the present embodiment. 4 includes an input device 51, an output device 52, a drive device 53, an auxiliary storage device 54, a memory device 55, and a CPU (Central Processing Unit) that performs various controls. 56 and a network connection device 57, which are connected to each other via a system bus B.

  The input device 51 has a pointing device such as a keyboard and a mouse operated by a user or the like, and inputs various operation signals such as execution of a program from the user or the like. Further, the input device 51 can also input various data such as an image of an already measured observation target region obtained from an external device connected to the network connection device 57 or the like via a communication network.

  The output device 52 has a display for displaying various windows and data necessary for operating the computer main body for performing processing according to the present invention, and displays the program execution progress, results, and the like by the control program of the CPU 56. can do. Further, the output device 52 can print the above processing result or the like on a print medium such as paper and present it to the user or the like.

  Here, the execution program installed in the computer main body in the present invention is provided by, for example, a portable recording medium 58 such as a USB (Universal Serial Bus) memory, a CD-ROM, or a DVD. The recording medium 58 on which the program is recorded can be set in the drive device 53, and the execution program included in the recording medium 58 is installed in the auxiliary storage device 54 from the recording medium 58 via the drive device 53.

  The auxiliary storage device 54 is a storage means such as a hard disk, and can store an execution program according to the present invention, a control program provided in a computer, etc., and perform input / output as necessary.

  The memory device 55 stores an execution program or the like read from the auxiliary storage device 54 by the CPU 56. The memory device 55 includes a ROM (Read Only Memory), a RAM (Random Access Memory), and the like.

  The CPU 56 controls processing of the entire computer, such as various operations and input / output of data with each hardware component, based on a control program such as an OS (Operating System) and an execution program stored in the memory device 55. Thus, each processing can be realized. Various information necessary during the execution of the program can be acquired from the auxiliary storage device 54, and the execution result and the like can also be stored.

  The network connection device 57 obtains an execution program from another terminal connected to the communication network by connecting to a communication network or the like, or an execution result obtained by executing the program or an execution in the present invention The program itself can be provided to other terminals. The network connection device 57 can also acquire various data such as an image of a portion to be observed that has already been captured by an external device connected to the communication network.

  With the hardware configuration as described above, the image analysis processing in the present invention can be executed. Further, by installing the program, the image analysis processing according to the present invention can be easily realized by a general-purpose personal computer or the like.

<Example of Image Obtained by Image Generation Unit 46>
Next, an example of an image obtained by the image analysis unit 45 and obtained by the image generation unit 46 from the analysis result will be described with reference to the drawings. FIG. 5 is a diagram for explaining an example of an analysis result image in the present embodiment. 5A shows an example in which moisture is visualized, and FIG. 5B shows an example of quantification data. Also, the three vertical images shown in FIG. 5A are a visible image from above, a near-infrared image captured using a filter that allows only the wavelength region to pass around about 1950 nm, and image analysis of the near-infrared image. The image which added the result was shown. Further, the two horizontal sheets show images when different cosmetics (for example, lotion, etc.) are applied, for example. In each figure described later, as an example, the near-infrared image is an image taken using a filter that passes only about 1950 nm, but the near-red region applied in the present invention is used. The range of the outer region is not limited to this.

  In the present embodiment, for example, an image representing absorption of moisture in the near-infrared region as brightness values is obtained, so that the moisture distribution state is shown simultaneously with the form (shape) and characteristics of the subject's skin surface. An image is obtained. Therefore, the image analyzer 45 performs, for example, preset image processing on the image, for example, as shown in FIG. It is possible to analyze a portion that is much moistened and a portion that is dry with little moisture, and the analysis result can be displayed on the screen of the output means 42 or the like. In addition, when displaying on a screen, you may perform the synthetic | combination process by a predetermined pseudo color based on a luminance value. As a result, for example, it is possible to display different colors for a portion with a lot of moisture and a dry portion so that the corresponding portion becomes clearer.

  In the present embodiment, as shown in FIG. 5B, the statistic can be calculated at an arbitrary site by the image analysis unit 45 in the moisture visualization image. Specifically, as shown in FIG. 5 (b), by specifying a region (part) to be observed by a user or the like for the images of a plurality of measurement results such as the first time and the second time, Quantitative data can be obtained by calculating the average value, standard deviation, etc. of the luminance by the analysis processing by the image analysis means 45. Further, these images and data are generated by the above-described image generation means 46 and displayed on the screen of the output means 42 and the like.

  Note that the above-described area (part) designation may be made by designating a plurality of areas for one image, for example. Also, the area may be specified for all of the plurality of measurement result images, or the same area may be specified for other measurement images by specifying the area for one image. It may be configured. In this case, for example, coordinate information or the like is embedded in each image in advance, and when specifying an area for a certain image, the coordinates are acquired and applied to other measurement images to specify the area.

<Advantage of Observing (Evaluating) Images Obtained by the Present Embodiment>
Next, the superiority of observing (evaluating) an image obtained by the above-described embodiment will be described with reference to the drawings. FIG. 6 is a diagram for explaining the superiority of evaluating an image obtained in the present embodiment. 6A shows the measurement results (for five times) according to the present embodiment, and FIG. 6B shows the results of the time series analysis in the present embodiment.

  In the example of FIG. 6, for example, an imaging means (camera 30) having sensitivity in the near infrared region having a wavelength region of about 1000 to 2500 nm, an optical system having high transmittance in the near infrared region, and a light source in the same wavelength region. Is an apparatus that is optimal for quantitative determination as well as visualization of the moisture state and the like by uniformly illuminating the observation surface using a dome-shaped or cup-shaped diffuse reflector 21.

  Further, in the example of FIG. 6, halogen light including a near infrared region is used as the light source 23, but in the present embodiment, an LED that generates light in an arbitrary near infrared region in order to avoid the influence of heat on the observation surface. By using a light source that hardly has heat, such as an SC light source or the like, the accuracy at the time of quantification by image analysis can be increased.

  That is, in this embodiment, since an image is acquired using the above-described method, for example, a moisture distribution state can be observed based on non-contact image information, and quantitative observation (evaluation) can be performed. Therefore, unlike the conventional method of electrical moisture measurement by contact with the skin, it is possible to make a comparison using quantitative numerical data of an arbitrary part together with an image that visualizes the moisture distribution state. Comparison of time-series changes and the like can also be performed using the advantage of contact.

  Here, in comparison with existing devices, there are SKICON (registered trademark) (IBS Co., Ltd.) and Cornemeter (C + K Co.) as conventional measuring devices for moisture content in the skin surface layer. The latter measures the moisture content by measuring the capacitance, and the latter measures the capacitance. Since these are mechanisms for measuring in contact with the observation object, they are affected by the shape of the surface of the measurement object, the angle at the time of contact, and the like.

  For example, in the case of skin supported by a skeleton and muscles such as the bent side of the forearm, a relatively stable measurement can be performed. However, when there is no support by the skeleton only with muscles like the cheeks of the face, the shape at the time of pressing changes and the measured value is not stable. In addition, measurement is difficult depending on the part. For example, in the case of an upper eyelid, since there is an eyeball underneath it, the pressing measurement is unstable, and the subject (subject) may be uncomfortable.

  On the other hand, in the measurement according to the present embodiment, non-contact photographing is possible by the configuration of the above-described diffuse reflection portion 21 and the like, and thus there is no influence such as contact or shape, so as shown in FIG. For example, stable results can be obtained with both the forearm and cheek. Further, in the measurement according to the present embodiment, since the same data is repeatedly obtained because the captured image is analyzed, the same position is maintained during photographing in the time series analysis as shown in FIG. 6B. Thus, a stable analysis value that is less affected by contact can be obtained.

  FIG. 7 is a diagram showing an example of moisture data obtained in the present embodiment. Compared to the conventional method for moisture data, conventionally, it was only possible to acquire the amount of moisture by contacting a device for each preset site, and to acquire the difference between the sites, changes before and after continuous use, and the like. However, according to the method of the present invention, since it is non-contact, it is possible to acquire and analyze a wide range of image data including the measurement site, so that efficient processing is possible. That is, according to the method of the present invention, it is possible to obtain moisture data for an arbitrary part by subdividing the entire data. Furthermore, according to the method of the present invention, it is possible to visualize the water content of the whole and each part by photographing the observation target using light in a predetermined near infrared region, and perform quantitative comparison by calculating statistics. You can also. These points are superior to the method of the present invention because they are not in the conventional method.

  Furthermore, in the diagram shown in FIG. 7, the analysis of the cheek portion of the subject is taken as an example, but the observation target in the present embodiment is not limited to this. Further, according to the method of the present invention that is an expansion type, more detailed data can be acquired. Here, as detailed data, for example, FIG. 6B is an enlarged view of the subdivided region in FIG. 7, and a region surrounded by an arbitrary groove (skin) or a groove (skin) ) Can be analyzed. Moreover, since the surface form which consists of a crevice and a skin mound changes with skin states, the analysis, evaluation, etc. which combined those characteristic features are also attained. Furthermore, for hair, analysis for cuticles is possible. The images and data shown in FIGS. 6 and 7 are generated by the image generation unit 46 described above and displayed on the screen of the output unit 42 and the like.

<Image example before and after sample application>
Next, image examples before and after sample application using the image acquisition device 11 including the illumination device 20 and the image analysis device 12 in the present embodiment will be described with reference to the drawings. 8 and 9 are diagrams (No. 1 and No. 2) showing an example of the skin condition before and after the sample application.

  In addition, the applied sample (a well-familiar thing and a bad thing) uses the cosmetic liquid as an example. 8 and 9 show images captured by the image acquisition device 11 including the illumination device 20. FIG.

  In FIG. 8 and FIG. 9, as an example, photographing was performed on a forearm bent side portion (inner portion of the forearm) of a woman. Further, as a photographing condition, an SC light source manufactured by Sumitomo Electric Industries, Ltd. was used as a light source, and the arrangement pattern of FIG. As the near-infrared digital camera 30, a near-infrared camera manufactured by Sumitomo Electric Industries, Ltd. (sensor: Type II quantum well type InGaAs photodiode FPA, wavelength region: 1000 to 2350 nm) was used.

  In this photographing, 1950 nm (center wavelength: 1950 nm, half-value width: 56 nm) was used as a bandpass filter which is the third filter of the illumination device 20 described above. In this photographing, only the third filter is used because the purpose is to confirm the essential part of seeing water. However, the present invention is not limited to this, and other filters (first filter) are used as described above. A filter and a second filter may be used. A clearer image can be acquired by using another filter. Specifically, for example, surface reflection can be removed by using a first filter, and the amount of light can be adjusted by using a second filter.

  For example, in the image of the skin 60 of the forearm of the woman shown in FIG. 8A, a portion containing a lot of moisture is displayed in black by using the lighting device 20 in the present embodiment. Here, with respect to the skin image of a woman's forearm, a moisture visualization image (FIG. 8 (b), FIG. 8 (d)) immediately after applying a sample that is familiar to the skin and a sample that is not familiar to the skin, respectively, A moisture visualization image (FIG. 8 (c), FIG. 8 (e)) 3 minutes after the application of the sample is acquired.

  In the case of a sample that is familiar to the skin, immediately after the application of the sample, it becomes a drop shape on the skin as shown in FIG. In other words, the inside of the contour shape 61 of the drop-like sample is displayed black because it contains a lot of moisture. In the example of FIG. 8B, the contour shape 61 of the sample has already begun to become familiar, and therefore the contour shape 61 has begun to spread.

  Further, after 3 minutes have passed since the sample application, it can be confirmed from the image that the contour shape 62 is larger than the contour shape 61 as shown in FIG. In addition, in the figure of FIG.8 (c), it can confirm that the sample osmose | permeates skin and spreads outside while entering a skin groove.

  On the other hand, in the case of a sample that is not familiar to the skin, immediately after application of the sample, it becomes a drop shape on the skin as shown in FIG. 8 (d), but the outline shape 63 of the sample has not started to become familiar with the skin and therefore does not spread. It becomes a state. Therefore, the contour shape 63 of FIG. 8D is smaller than the contour shape 61 even though it is immediately after the application even when compared with the drop-shaped contour shape 61 of FIG.

  Further, as shown in FIG. 8E, it can be seen that there is not much difference between the contour shape 64 and the contour shape 63 after 3 minutes have passed since the sample application.

  That is, by applying the lighting device 20 or the like according to the present embodiment, it is possible to visualize how it changes over time due to differences in familiarity with the skin. In addition, the white ring-shaped white part (pattern) shown in FIG. 8 is a drop-shaped surface reflected by the light source, and it is possible to appropriately grasp the familiarity with the skin by checking this part. .

  Moreover, in the example of FIG. 9, with respect to the image of the skin 70 of the female forearm (FIG. 9A), the image of the skin immediately after applying the sample (FIG. 9B), and 3 immediately after the application. The image of the skin after the minute (FIG. 9C) is shown.

  In the image of FIG. 9A, since the moisture in the dry portion of the skin is small, it is displayed in white. By applying a sample to the whitely displayed portion as shown in FIG. 9B, the image shown in FIG. That is, the drop-like contour shape 71 immediately after application becomes large like the contour shape 72 after 3 minutes, and the familiarity can be grasped from the size.

  Furthermore, in this embodiment, after the sample has become familiar with the skin, the luminance value of the familiarized portion decreases due to the influence of moisture contained in the sample. For example, the image of FIG. 9 (c) is displayed to such an extent that the skin groove and skin can be recognized as compared with the image of FIG. 9 (b). (Including the portion) has a lower luminance value than the image of FIG. 9A and is displayed in black. Therefore, it is possible to easily grasp that the applied sample has penetrated into the skin and the moisture content of the skin has increased (how the sample fits into the skin) from the image acquired according to the present embodiment.

  By applying the illumination device 20 or the like in the present embodiment, it is possible to capture a near-infrared region image with high accuracy, and to obtain a moisture visualization image as shown in FIGS. 8 and 9 described above. Therefore, immediately after application, it becomes possible to visualize how the droplet-like sample changes over time due to the difference in familiarity, the familiarity of the sample with the skin, and the like.

  Note that the images in FIGS. 8 and 9 described above are converted into original images using pseudo colors or the like corresponding to the luminance difference analyzed by the image analysis unit 45 by the image generation unit 46 of the image analysis apparatus 12 described above. The synthesized images may be displayed, and the present invention is not limited to this.

<Other application examples>
In the present embodiment described above, a high-accuracy image can be acquired as an example of the skin such as the user's cheek, and further, the analysis and observation (evaluation) contents using the image have been described. The present invention is not limited and can be applied to other observation targets. Here, another application example in the present invention will be described with reference to the drawings.

  FIG. 10 is a diagram illustrating another application example in the present embodiment. FIG. 10 (a) shows an example of cosmetic comparison in hair, and FIG. 10 (b) shows a comparative example of healthy hair and damaged hair.

  In the present embodiment, for example, as shown in FIGS. 10A and 10B, a visualized image of moisture and quantitative data can be acquired even for a sample other than the skin, such as hair. In addition, in Fig.10 (a), the comparison result of the moisture content at the time of applying the cosmetics (for example, sample A, sample B) from which the moisture retention ability differs with respect to the enlarged image of the hair, and the image part to hair, respectively. Is shown. In the present embodiment, the amount of moisturizing can be visualized by photographing using the image acquisition device 11 described above, and quantification data such as an average value is calculated from the image by the image analysis unit 45 or the like. Can be displayed.

  FIG. 10B shows a comparison between healthy hair and damaged hair. As shown in FIG. 10 (b), the damage portion included in the hair is displayed in pseudo color, so that the portion can be easily grasped, and the average value or the like is obtained from the image by the image analysis means 45 or the like. The quantified data can be calculated and displayed. That is, in this embodiment, as shown in FIG. 10A and FIG. 10B, the skin and hair can be evaluated and observed with higher accuracy by visualizing the object.

  Note that the images and data shown in FIGS. 10A and 10B are generated by the above-described image generation means 46 and displayed on the screen of the output means 42 and the like. Further, in the present embodiment, the image example generated by the image generation unit 46 is not limited to FIGS. 5 to 8, and for example, an image that combines a plurality of images in FIGS. 5 to 8 is generated. You can also.

  As described above, according to the present invention, an image in the near infrared region can be taken with high accuracy. Specifically, according to the present invention, it is possible to specifically analyze moisture, oil, and the like by magnifying and observing an image in the near infrared region with high accuracy.

  Further, by applying the present invention, as expected effects, for example, conventional skin moisture measurement is mainly based on electrical measurement principles (resistance value and capacitance), and only numerical values are used. However, according to the present invention, the moisture distribution on the skin surface can be visualized and displayed. Further, if necessary, it can be displayed as a numerical value from the image luminance value of the specific part.

  In addition, by applying the present invention, there is a possibility that the numerical value may fluctuate depending on the form of the skin surface and the contact state of the measuring device in the conventional electrical method, but the measurement site itself is imaged and measured without contact. Therefore, relatively stable measurement is possible.

  Furthermore, the effect of the technique using the image is that the moisture content of the target part can be visualized and quantified while observing the measurement object, so the change in moisture distribution depending on the microscopic form Etc. can be measured.

  Furthermore, in the above-mentioned advantages, for example, at present, there is an application of an electrical technique used on the skin, but stable measurement cannot be performed due to physical problems such as contact with hair. However, by applying the present invention, for example, when moisture in the scalp is measured, it is possible to measure while visually observing hair and skin.

  Further, in the evaluation method according to the present embodiment, numerical comparison of specific parts, distribution state in a fixed region can be performed, and since it is an image, for example, dynamic evaluation by a video function is possible in a non-contact state.

  In addition, based on said effect, this invention is anticipated not only as research equipment but the utilization for the counseling in a shop front. Furthermore, in the present invention, the same effect as described above can be obtained not only for moisture but also for those that can be identified in the near infrared region such as oil.

  The preferred embodiments of the present invention have been described in detail above, but the present invention is not limited to such specific embodiments, and various modifications, within the scope of the gist of the present invention described in the claims, It can be changed.

DESCRIPTION OF SYMBOLS 10 Skin observation system 11 Image acquisition apparatus 12 Image analysis apparatus 20 Illumination apparatus 21 Diffuse reflection part 22 Opening part 23 Light source 24 Transmission lens 25 Polarization filter (1st filter)
26 ND filter (second filter)
27 Bandpass filter (third filter)
28 Ultraviolet Filter 29 Infrared Cut Filter 30 Near-Infrared Digital Camera 41 Input Unit 42 Output Unit 43 Storage Unit 44 Captured Image Acquisition Unit 45 Image Analysis Unit 46 Image Generation Unit 47 Transmission / Reception Unit 48 Control Unit 51 Input Device 52 Output Device 53 Drive device 54 Auxiliary storage device 55 Memory device 56 CPU
57 Network connection device 58 Recording medium 60, 70 Skin 61-64, 71, 72 Contour shape

Claims (8)

In an illumination device for photographing a target portion of a subject in a predetermined near infrared region,
A plurality of light sources that irradiate light of the predetermined near infrared region from the opening to the target site;
Imaging means for photographing the target portion irradiated by the plurality of light sources,
On the optical path from the light source to the imaging means, a first filter for removing surface reflected light from the target region, a second filter for adjusting the amount of light from the light source, and a preset wavelength And a third filter that allows only the region to pass therethrough.   The illumination device according to claim 1, further comprising a fourth filter that blocks ultraviolet rays and infrared rays that are installed in front of the light source.   3. The lighting device according to claim 1, wherein the plurality of light sources are arranged at different distances from a predetermined center serving as a reference. 4. The plurality of light sources are a first light source that emits light in a first near infrared region, and a second light that emits light in a second near infrared region different from the first near infrared region. A light source,
The lighting device according to any one of claims 1 to 3, wherein the first light source and the second light source are alternately arranged.   The lighting device according to claim 1, wherein the plurality of light sources are arranged so as to be irradiated at different angles with respect to the opening.   6. The device according to claim 1, wherein the plurality of light sources uses at least one of a halogen light source, an LED, and a super continuum (SC) light source for photographing a near-infrared region. The lighting device described.   The predetermined near-infrared region is at least one band among 1100 to 1360 nm, 1300 to 1640 nm, 1860 to 2200 nm, 1700 to 1860 nm, and 2230 to 2400 nm. The lighting device according to claim 1. An image analysis apparatus that performs analysis using an image of a target portion of a subject in a predetermined near-infrared region imaged by the illumination device according to any one of claims 1 to 7,
Image acquisition means for acquiring a local image of the subject;
Image analysis means for analyzing the state of the target portion included in the image obtained by the image acquisition means;
An image analysis apparatus comprising: screen generation means for generating a screen for displaying an analysis result obtained by the image analysis means.