JP7049034B2 - Skin condition measuring device - Google Patents

Description

The present invention relates to a skin condition measuring device.

As a tool for measuring skin condition in face-to-face sales of cosmetics and beauty counseling, a temperature sensor for measuring skin temperature, a moisture sensor for measuring moisture content, a sebum sensor for measuring the amount of sebum, and an elasticity sensor for measuring elasticity. There is a skin condition measuring device having a sensor unit incorporating the above and a camera unit for taking an enlarged image of the skin. This camera unit takes a reflected image (surface reflected light image) suitable for observing surface irregularities on the skin and a non-reflective image (skin color image due to internal reflected light) suitable for observing the distribution of capillaries and pigmentation. It is possible to provide an ON / OFF switch for taking a reflected image and an ON / OFF switch for taking a non-reflective image (Patent Document 1).

Further, there is known a skin condition measuring device that integrally incorporates an image pickup unit that is formed by light transmitted through the skin and captures a transparency image useful for evaluating the transparency of the skin and the above-mentioned sensor unit (patented). Document 2, Patent Document 3). In these devices, the image pickup unit and the ON / OFF operation of each sensor are performed by the operator manually operating the operation unit provided in the device.

On the other hand, as lighting for taking a magnified image of the skin, side emission is suitable for visually capturing and observing surface irregularities, and epi-illumination is suitable for observing the overall color tone and the rough slip condition of the surface. It is known that there is. In this regard, a lighting device capable of switching between side-illuminated lighting and epi-illuminated lighting has been proposed (Patent Document 4).

Japanese Unexamined Patent Publication No. 2002-355223 Japanese Unexamined Patent Publication No. 2011-130806 Japanese Unexamined Patent Publication No. 2013-121409 Japanese Unexamined Patent Publication No. 5-199442

In order to analyze the skin condition from the image in a multifaceted manner, the lighting method and light reception such as surface reflected light or internal reflected light image, side-lit or epi-illuminated image, transmitted light or reflected light image, etc. It is preferable to take a plurality of types of magnified images of different methods at once at the same imaging position.

However, for example, if a multi-directional switch is operated in the operation unit of the skin condition measuring device or an ON / OFF switch is operated in order to take a plurality of types of magnified images at a predetermined part of the skin, the imaging position may shift due to camera shake. It may be out of focus. That is, in general, a device for measuring a skin condition captures a magnified image having a magnification of about 40 times, so that the influence of image stabilization and blurring due to camera shake is large, and there is a concern that the analysis accuracy will be greatly reduced due to camera shake.

On the other hand, it is an object of the present invention to eliminate camera shake due to switch operation when taking a plurality of types of magnified images at a predetermined part of the skin.

When the skin temperature is measured by the temperature sensor, the present inventor converges while the temperature measured by the temperature sensor fluctuates from the initial environmental temperature to the original skin temperature, and the fluctuation of this temperature is within a predetermined range. When it is detected that the temperature has converged to the above and the continuous shooting of multiple types of images is performed with this detection as an opportunity, the switch operation performed by the operator to take the image becomes unnecessary, and the camera shake caused by the switch operation is eliminated. And completed the present invention.

That is, the present invention includes a temperature sensor that measures the skin temperature, a monitoring means that monitors the temperature measured by the temperature sensor, and an imaging unit that can continuously shoot a plurality of types of images on a predetermined part of the skin. Provided is a skin condition measuring device, wherein the imaging unit starts the continuous shooting when the temperature fluctuation monitored by the monitoring means converges within a predetermined range after the skin temperature measurement is started. ..

According to the skin condition measuring device of the present invention, when the measured temperature fluctuation converges within a predetermined range after starting the measurement of the skin temperature by the temperature sensor, the image pickup unit has a plurality of types with respect to the predetermined part of the skin. Since the continuous shooting of images is started, the operator of the skin condition measuring device does not need to operate the switch to take an image, and the camera shake due to the switch operation does not occur. Therefore, it is possible to take a plurality of types of images at the same position without displacement, and it is possible to eliminate out-of-focus due to camera shake.

FIG. 1A is a perspective view of the skin condition measuring device of the embodiment. FIG. 1B is a perspective view of the skin condition measuring device of the embodiment placed on the stand. 2A and 2B are a top view (display side) and a bottom view (imaging unit side) of the skin condition measuring device of the embodiment. FIG. 3 is a diagram showing changes over time in temperature monitored by the monitoring means of the skin condition measuring device of the embodiment. FIG. 4 is an explanatory diagram of a method of calculating the temperature change rate in the monitoring means of the skin condition measuring device of the embodiment. FIG. 5A is an explanatory diagram of an image pickup method of an epi-illumination image. FIG. 5B is an explanatory diagram of an image pickup method of a side-illuminated illumination image. FIG. 5C is an explanatory diagram of a method of capturing a skin color image. FIG. 5D is an explanatory diagram of a method of capturing a transparent image. FIG. 6 is an operation flow when a plurality of types of images are taken at the same position of a predetermined part of the skin by the imaging unit of the skin condition measuring device of the embodiment.

Hereinafter, the present invention will be described in detail with reference to the drawings. In each figure, the same reference numerals represent the same or equivalent components.

(overall structure)
FIG. 1A is a perspective view of the skin condition measuring device 1 of the embodiment of the present invention as viewed from the display 2 side, and FIG. 2 is a top view (display side) and (b) bottom view (imaging unit) thereof. Side).

The skin condition measuring device 1 includes a temperature sensor that measures the skin temperature, a monitoring means that monitors the temperature measured by the temperature sensor, and an imaging unit that can continuously shoot a plurality of types of images on a predetermined part of the skin. ing. In FIG. 2B, reference numeral 3 is a heat-sensitive portion of the temperature sensor, and reference numeral 11 is an opening portion of the imaging portion. After the skin temperature is measured by the temperature sensor, the skin condition measuring device 1 detects that the temperature fluctuation monitored by the monitoring means has converged within a predetermined range, and the image pickup unit continuously shoots with the detection as an opportunity. It is characterized by starting.

A multi-sensor 20 in which a moisture sensor 22, an elasticity sensor 23, a sweating sensor 24, and a sebum sensor 25 are mounted on a movable surface 21 is provided on the surface of the skin condition measuring device 1 on the opening 11 side of the imaging unit. ing. Each sensor constituting the multi-sensor 20 includes Japanese Patent Application Laid-Open No. 2013-121409 (Patent Document 3), Japanese Patent Application Laid-Open No. 2009-153727, Japanese Patent Application Laid-Open No. 2011-130805, and Japanese Patent Application Laid-Open No. 2011-130806 cited in the same publication. It can be configured in the same manner as the corresponding sensor described in the publication. The skin condition measuring device of the present invention is not limited to the moisture sensor 22, the elasticity sensor 23, the sweating sensor 24 and the sebum sensor 25 shown in FIG. 2, but is equipped with a contact thermometer and other various sensors as needed. be able to.

The captured image and the measurement data by each sensor are recorded in the storage device of the microcomputer provided in the skin condition measuring device 1.

Further, the skin condition measuring device 1 has a main switch 5 for turning on / off the main power supply and a center button 6 for performing various operations. The display 2 is a touch panel, and a selection screen of a measurement menu to be measured by the skin condition measuring device 1 is displayed and can be selected by touching. Further, the measurement result can be displayed on the display 2.

As shown in FIG. 1B, the skin condition measuring device 1 is detachably mounted on the stand 4. The stand 4 is provided with a power connector, a LAN connector, and a USB connector. When the skin condition measuring device 1 is placed on the stand 4, the internal battery of the skin condition measuring device 1 is charged. Further, the skin condition measuring device 1 can be connected to an external computer connected to the stand 4 while being mounted on the stand 4, and various data measured by the skin condition measuring device 1 can be externally connected. It is possible to analyze with a computer or the like.

(Temperature sensor)
As the temperature sensor, it is preferable to use a radiation thermometer which is a non-contact thermometer. When the skin temperature is measured in a non-contact manner, there is a time lag until the temperature fluctuation measured by the temperature sensor converges to the original temperature of the skin. Therefore, this convergence state can be monitored by the monitoring means, and when the temperature fluctuation converges within a predetermined range, a trigger signal for starting continuous shooting can be generated in the imaging unit. Among the radiation thermometers, those having a short measurement distance and a wide measurement range (target size) are preferable. In addition to the radiation thermometer, thermography or the like can also be used as the temperature sensor in the present invention.

(Monitoring means)
The monitoring means monitors the temperature measured by the temperature sensor and detects the time when the time-dependent fluctuation of the monitored temperature converges within a predetermined range. This detection can be performed, for example, by detecting when the rate of change in the monitored temperature falls within a predetermined range, or when the fluctuation range of the temperature falls within a predetermined range.

More specifically, FIG. 3 shows a typical change over time in temperature when the temperature of the cheek or forehead is measured with a radiation thermometer. In this way, the measured temperature converges to the skin temperature while fluctuating. Therefore, the temperature is sampled at intervals of 0.05 to 0.2 seconds (for example, at intervals of 0.2 seconds in FIG. 4) after the start of skin temperature measurement (that is, the start of monitoring), and the slope of the temperature change for 1 second is the least squares method. Calculated in, and use this as the rate of change in temperature. The temperature change rate is calculated sequentially by shifting the sampling time as the sampling progresses. In addition, the moving average is calculated at the same time as the calculation of the temperature change rate.

The monitoring means detects when the temperature change rate falls within a predetermined range, for example, preferably in the range of −1.6 × 10 ^-3 to 1.6 × 10 ^-3 ° C / sec, and immediately after that, a trigger signal is signaled. Occurs. Further, it is preferable to store the moving average temperature at this time as the skin temperature. It usually takes about 2 seconds for the rate of change to reach this range after the start of skin temperature measurement.

On the other hand, when detecting the time point at which the temperature fluctuation over time converges within a predetermined range by the temperature fluctuation range instead of the temperature change rate, for example, the monitored temperature is sampled as described above. The standard deviation of the sampled temperature for 1 second may be calculated sequentially, and the time when the standard deviation falls within a predetermined range may be detected.

The temperature has been stable since the rate of temperature change or standard deviation fell within the above range, for example, women in their 20s to 60s with a radiation thermometer, 40 in each age group, a total of 200 cheeks and foreheads. When the temperature of was measured at 0.1 second intervals, the temperature change rate was in the range of -1.6 x 10 ^-3 to 1.6 x 10 ^-3 ° C / sec for 1 second (section 1). The average temperature, standard deviation, and rate of change were as follows, and the same was true for the next 1 second (section 2).
Cheek: Average 31.43 ° C, standard deviation 0.70, temperature change rate 3.7 × 10 ^-4 ° C / sec Amount: Average 32.72 ° C, standard deviation 0.62, temperature change rate 2.1 × 10 ^-4 ° C / sec

In addition, the function to monitor the temperature measured by the temperature sensor, the temperature is sampled from the monitored temperature at predetermined intervals, the temperature change rate is calculated as described above, and the time when the calculated change rate reaches the predetermined range is reached. The function of detecting and the function of generating a trigger signal at the time of detection can be formed by using a microcomputer.

(Image pickup unit)
In the present invention, the image pickup unit has an image sensor, an image pickup lens, a lighting device, a shutter, a controller for driving the shutter, and if necessary, a polarizing plate, a lighting system lens, and the like. In addition, the imaging unit has a function of sequentially continuously shooting a plurality of types of images on a predetermined portion of the skin.

As the type of the image taken by the image pickup unit, an epi-illumination image or a side-illumination image can be given from the point of view of the illumination angle, and a surface reflected light image or an internal reflection from the point of presence or absence of polarization of the illumination light and the image pickup light. An optical image (skin color image) can be given, a reflected light image or a transmitted light image can be given from the viewpoint of whether the image is formed by reflected light or transmitted light, and further, the skin can be given in the transmitted light image. By making the position where the illumination light is incident and the position where the image pickup light is received different from each other on the surface, it is possible to form a transparency image in which the transparency of the skin can be evaluated. As the type of image, these viewpoints are appropriately combined as necessary to obtain two or more types, preferably three or more types of images.

For example, the image pickup unit 10A shown in FIG. 5A has a CMOS 13 as an image sensor and an LED 14a as a lighting device in the lens barrel 12. The CMOS 13 is formed directly above the opening 11, and the LED 14a is arranged next to the CMOS 13 and substantially directly above the opening 11. Therefore, when the opening 11 is applied to a predetermined imaging portion of the skin S and the illumination light is irradiated from the LED 14a, the reflected light passes through the imaging lens 15 and an epi-illumination image is formed on the CMOS 13. According to the epi-illumination image, information such as the texture of the skin can be quantitatively observed.

In the imaging unit 10B shown in FIG. 5B, the LED 14b is arranged on the side of the imaging lens 15 with respect to the imaging unit 10A shown in FIG. 5A, and the ring lens 16 is placed around the opening 11 in the lens barrel 12. It is the one that was placed. According to the image pickup unit 10B, the illumination light is emitted from the LED 14b on the side of the imaging lens 15, bent by the ring lens 16, incident on the skin S in the opening 11 at a low angle, and side-illuminated on the CMOS 13. An image is formed. The side-illuminated image can clearly capture the unevenness and texture of the surface of the skin.

The image pickup unit 10C shown in FIG. 5C arranges the polarizing plate 17a on the front surface of the LED 14a and also arranges the polarizing plate 17b on the front surface of the imaging lens 15 with respect to the image pickup unit 10A shown in FIG. 5A. The polarization directions of the polarizing plates 17a and 17b are orthogonal to each other. As a result, the surface reflected light of the skin S is cut by the polarizing plate 17b, and the internal reflected light image (skin color image) of the skin is formed on the CMOS 13. In the internally reflected light image, it is possible to observe the color of the skin regardless of the surface unevenness of the skin.

The image pickup unit 10D shown in FIG. 5D turns off the LED 14a on the side of the CMOS 13 with respect to the image pickup unit 10A shown in FIG. Of the incident light, the light transmitted through the skin S is received from the opening 11 so that a transmitted light image is formed on the CMOS 13. This transmitted light image reflects the transparency of the skin and is called a transparency image. When taking a transparent image, a polarizing plate may be used to surely prevent the surface reflected light of the illumination light from being received by the image sensor, in order to increase the amount of received light and make the image easier to see. The polarizing plate may be omitted.

The type and number of images to be continuously shot in each skin condition measuring device can be appropriately determined according to the use of the skin condition measuring device. For example, in general beauty counseling at a store, the epi-illumination image, the internally reflected light image, and the transparency image may be switched in sequence, and the skin condition measuring device 1 of the embodiment continuously shoots these three types of images. On the other hand, when observing the texture of the skin is the main focus, the epi-illumination image, the side-illumination image, and the internally reflected light image may be switched in sequence.

In any of the above-mentioned types of images, it is preferable that the imaging lens 15 has a constant focus so that the surface of the skin S applied to the opening 11 is in focus. As a result, the focusing operation can be omitted, and each image can be clearly taken even if a plurality of types of images are continuously shot. Further, it is preferable to select a lens system composed of an imaging lens 15 or the like so that the magnification of the image can be increased to 30 to 50 times.

In the present invention, there is no particular limitation on the method itself for sequentially continuously shooting a plurality of types of images at a predetermined part of the skin at the same imaging position, and the lighting apparatus described in JP-A-2010-88599, JP-A-2012-234081 and the like. Can be done in the same way as. Further, the LED 14a for the epi-illumination image, the LED 14b for the side-illumination image, and the LED 14c for the transparency image may be provided in one lens barrel 12, and they may be turned on or off in synchronization with continuous shooting. For example, a rotating plate to which a polarizing filter is partially attached is used as the polarizing plate so that the presence or absence of the polarizing plates 17a and 17b can be changed in synchronization with continuous shooting, and the rotating plate is rotated. This may allow the use or non-use of the polarizing filter to be switched quickly.

The speed of continuous shooting is preferably 0.8 to 1.2 seconds per image from the viewpoint of stabilizing the amount of light of illumination.

The imaging unit of the skin condition measuring device of the present invention is characterized in that continuous shooting for sequentially switching a plurality of types of images starts automatically when the temperature fluctuation monitored by the monitoring means converges within a predetermined range. It is supposed to be. Therefore, in the present invention, as described above, the monitoring means generates a trigger signal so that the image pickup unit immediately starts continuous shooting when the trigger signal is detected, particularly the trigger signal is detected. It is preferable that continuous shooting is started immediately after that. This eliminates the need to manually operate the switch to start continuous shooting, eliminates camera shake associated with the switch operation, and allows multiple types of images taken at the same imaging position to be obtained, and these can be accurately compared. It will be possible. Further, by starting continuous shooting immediately after receiving the trigger signal, it is possible to minimize the time required for a series of measurements from the measurement of the skin temperature to the acquisition of a plurality of types of images.

In general, there is known a technique of autofocusing by measuring the contrast of an image so that the shutter is released when the subject is in focus. Therefore, in order to eliminate camera shake associated with the switch operation for starting continuous shooting, it is conceivable to use a technique for measuring contrast. However, the technique of autofocusing by measuring the contrast is not effective when the subject is fair skin or smooth skin.

Further, in order to eliminate camera shake caused by the switch operation for starting continuous shooting, it is possible to set the continuous shooting to start automatically when a predetermined time has elapsed after the start of skin temperature measurement. However, in this case, since the time from the start of skin temperature measurement to the start of imaging is uniformly determined, the time from the start of skin temperature measurement to the start of imaging cannot be minimized in each imaging scene.

(Operation flow for continuous shooting of multiple types of images)
FIG. 6 is an operation flow in the case of continuously shooting a plurality of types of images at the same position of a predetermined part of the skin using the skin condition measuring device 1 of the embodiment.

First, the main switch 5 is turned on, and "start shooting" is selected from the menu displayed on the touch panel display 2.

Further, the heat-sensitive portion 3 of the temperature sensor of the skin condition measuring device 1 is applied to a predetermined portion of the skin. By selecting "start imaging" described above, the monitoring means starts monitoring the temperature detected by the temperature sensor, and sequentially obtains the temperature change rate and the moving average at predetermined time intervals.

Immediately after the temperature change rate monitored by the monitoring means falls within a predetermined range, the imaging unit automatically starts continuous shooting of the epi-illumination image, the internally reflected light image, and the transparency image. The continuously shot images are images taken at the same imaging position of a predetermined part of the skin.

During continuous shooting, the monitoring of skin temperature and the measurement of skin temperature (moving average) by the monitoring means are completed.

If necessary, it may be possible to manually start continuous shooting separately from the above-mentioned continuous shooting start based on the rate of change in temperature, and each of the epi-illumination image, the internally reflected light image, and the transparency image. The images may be taken separately.

The various images and data such as skin temperature obtained by the above operations are stored in the storage unit included in the skin condition measuring device 1.

(Operation flow of measurement by multi-sensor)
In the skin condition measuring device 1 of the embodiment, the measurement by the multi-sensor 20 can be performed independently of the continuous shooting of the above-mentioned images. Similar to continuous shooting of images, when the rate of change in temperature monitored by the monitoring means falls within a predetermined range, measurement by each sensor in the multi-sensor 20 may be started, or may be started at different timings. good.
The measurement data obtained by the multi-sensor 20 is also stored in the storage unit included in the skin condition measuring device 1.

The skin condition measuring device of the present invention has been described above based on the skin condition measuring device 1 of the embodiment. However, in the skin condition measuring device of the present invention, a plurality of types of images are connected to a predetermined part of the skin by an imaging unit. When taking a picture, the skin temperature is first measured, it is detected that the measured temperature fluctuation has converged within a predetermined range, and the continuous shooting is started with that as an opportunity. Various embodiments can be taken with respect to the method of capturing individual images.

Further, in the skin condition measuring device 1, the mounting of the multi-sensor 20 may be omitted if necessary, and various skin sensors may be mounted instead of the multi-sensor 20.

1 Skin condition measuring device 2 Display 3 Heat-sensitive part of temperature sensor 4 Stand 5 Main switch 6 Center button 10, 10A, 10B, 10C, 10D Imaging unit 11 Imaging unit opening 12 Lens barrel 13 CMOS
14a, 14b, 14c LED
15 Imaging lens 16 Ring lens 17a, 17b Polarizing plate 20 Multi-sensor 21 Movable surface 22 Moisture sensor 23 Elasticity sensor 24 Sweat sensor 25 Sebum sensor S Skin

Claims (6)

It was measured by applying a non-contact temperature sensor that measures the skin temperature to a predetermined part of the skin , a heat-sensitive part that is the measurement range of the temperature sensor, and a heat-sensitive part of the temperature sensor against the predetermined part of the skin. A skin condition measuring device provided with a monitoring means for monitoring temperature and an imaging unit capable of continuously shooting a plurality of types of images by applying an opening of the imaging unit to a predetermined portion of the skin.
A skin condition measuring device in which the imaging unit starts continuous shooting when the temperature fluctuation monitored by the monitoring means converges within a predetermined range after the skin temperature measurement is started. The skin condition measuring device according to claim 1, wherein the monitoring means calculates the rate of change in the monitored temperature over time, and when the rate of change in temperature falls within a predetermined range, the imaging unit starts continuous shooting. .. The skin condition measuring device according to claim 2, wherein the imaging unit starts continuous shooting immediately after the temperature change rate falls within a predetermined range. The skin condition measuring device according to any one of claims 1 to 3, wherein the temperature sensor is a radiation thermometer. The skin condition according to any one of claims 1 to 4, wherein the plurality of types of images are selected from an epi-illumination image, a side-illumination image, a skin color image due to internally reflected light, and a transparency image formed by the transmitted light of the skin. Measuring device. The skin condition measuring device is equipped with a multi-sensor having two or more types selected from a moisture sensor, an elasticity sensor, a sweating sensor, a sebum sensor, and a contact thermometer, and the temperature fluctuation monitored by the monitoring means is within a predetermined range. The skin condition measuring device according to any one of claims 1 to 5, wherein the multi-sensor starts measurement when the sensor converges to.

Images