JP2013056011A - Measuring device, measuring method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To separately measure a temperature of skin and a temperature of a region excluding the skin of a person.SOLUTION: A camera images a subject. A skin detection part detects the skin region representing the skin of the subject based on a first captured image obtained by imaging when irradiating the subject with a first wavelength light, and a second captured image obtained by imaging when irradiating the subject with a second wavelength light, which is longer than the first wavelength light. A skin temperature acquisition part acquires at least one of the skin temperature and the temperature of the non-skin region based on the skin region. The invention is applicable to for example, a measuring device to detect the skin region of the subject from the captured image.

Description

  The present disclosure relates to a measurement apparatus, a measurement method, and a program, and more particularly, to a measurement apparatus, a measurement method, and a program that can measure, for example, a temperature of a human skin part and a temperature other than the skin part.

  For example, there is an infrared camera that detects a far infrared ray generated from an object and measures a temperature. For example, the infrared camera captures a predetermined imaging range, thereby generating a temperature distribution image representing a temperature distribution within the imaging range.

  For this reason, an infrared camera is provided in an airport etc. as a pandemic countermeasure, for example, and is used in order to measure a human body temperature.

  In addition, there is an air conditioning control technology that detects an area where a human is present from a captured image obtained by imaging, measures the temperature of the area, and controls air conditioning (see, for example, Patent Document 1).

JP 2010-159877 A

  However, since the above infrared camera measures only the temperature distribution within the imaging range, it distinguishes whether the temperature obtained by the measurement is a human body temperature or a temperature of an object other than a human being. Difficult to do.

  In the above-described air conditioning control technique, a region where a human is present is detected from a captured image based on the shape and movement of an object on the captured image. For this reason, an object other than a human being may be erroneously detected and the temperature measured, and air conditioning may be controlled according to the temperature of the object other than a human being.

  This indication is made in view of such a situation, and makes it possible to distinguish and measure the temperature of a human skin part, and the temperature of parts other than skin.

  A measurement device according to one aspect of the present disclosure includes an imaging unit that images a subject, a first captured image obtained by imaging when the subject is irradiated with light of a first wavelength, and the subject On the other hand, a skin region representing the skin portion of the subject is detected based on a second captured image obtained by imaging when light having a second wavelength that is longer than the first wavelength is irradiated. It is a measuring device containing a skin detection part and the temperature acquisition part which acquires at least one of the temperature of the said skin part, or the temperature of the non-skin part different from the said skin part based on the said skin area | region.

  A generation unit that generates a temperature distribution image representing a temperature distribution within a range where the subject exists can be further provided, and the temperature acquisition unit is configured to generate the skin portion from the temperature distribution image based on the skin region. It can acquire by detecting at least one of the temperature of this, or the temperature of the said non-skin part.

  A condition temperature acquisition unit that acquires a temperature that satisfies a predetermined condition from the temperature of the skin part may be further provided.

  The conditional temperature acquisition unit may acquire at least one of a maximum value of the skin part temperature, a minimum value of the skin part temperature, or an average value of the skin part temperature from the temperature of the skin part. it can.

  A condition area detector that detects a skin area distribution area representing a temperature distribution satisfying a predetermined condition among the temperatures of the skin area from the temperature distribution image can be further provided.

  In the condition area detection unit, the first skin part distribution area that is set to be equal to or higher than the first temperature among the temperature of the skin part, and the second that is less than the second temperature among the temperature of the skin part. The skin part distribution area or the temperature of the skin part can be detected at least one of the third skin part distribution areas having a temperature within a predetermined range.

  In the temperature acquisition unit, based on the intensity of light rays emitted from at least one of the skin part or the non-skin part detected based on the skin region, the temperature of the skin part or the temperature of the non-skin part It can be obtained by measuring at least one of them.

  A change detection unit that detects a change in the temperature based on the temperature acquired by the temperature acquisition unit and an execution unit that executes a process according to a detection result of the change detection unit can be further provided.

  A first irradiating unit that irradiates the subject with light having the first wavelength and a second irradiating unit that irradiates the subject with light having the second wavelength may be further provided.

  A measurement method according to one aspect of the present disclosure is a measurement method of a measurement apparatus including an imaging unit that captures an image of an object when the measurement apparatus irradiates the object with light having a first wavelength. Based on a first captured image obtained by imaging, and a second captured image obtained by imaging when the object is irradiated with light having a second wavelength longer than the first wavelength. And detecting at least one of a temperature of the skin part or a temperature of a non-skin part different from the skin part based on the skin area and detecting a skin area representing the skin part of the subject. A temperature acquisition step.

  A program according to one aspect of the present disclosure is a first captured image obtained by imaging when a computer of a measurement apparatus including an imaging unit that captures an image of a subject is irradiated with light having a first wavelength. , And a skin portion of the subject based on a second captured image obtained by imaging when the subject is irradiated with light having a second wavelength that is longer than the first wavelength. A program for functioning as a skin detection unit that detects a skin region and a temperature acquisition unit that acquires at least one of the temperature of the skin portion or the temperature of a non-skin portion different from the skin portion based on the skin region It is.

  According to the present disclosure, the first captured image obtained by imaging when the subject is irradiated with light having the first wavelength, and the subject has a longer wavelength than the first wavelength. A skin area representing the skin part of the subject is detected based on a second captured image obtained by imaging when the light of the second wavelength is irradiated, and the temperature of the skin part is determined based on the skin area. Alternatively, at least one of the temperatures of the non-skin part different from the skin part is acquired.

  According to this indication, it becomes possible to distinguish and measure the temperature of a human skin part, and the temperature of parts other than skin.

It is a block diagram which shows the structural example of the measuring apparatus which is this Embodiment. It is a figure which shows an example of a temperature distribution image. It is a figure which shows an example of a binarized skin image. It is a figure which shows an example of a skin part temperature image. It is a figure which shows the spectral reflection characteristic with respect to human skin. It is a flowchart for demonstrating the skin temperature measurement process which a measuring device performs. It is a block diagram which shows the structural example of a computer.

Hereinafter, an embodiment of the present disclosure (hereinafter referred to as the present embodiment) will be described. The description will be given in the following order.
1. Embodiment (an example of acquiring temperature distribution of skin from a temperature distribution image)
2. Modified example

<1. Embodiment>
[Configuration Example of Measuring Device 21]
FIG. 1 shows a configuration example of a measuring apparatus 21 according to the present embodiment.

  The measuring device 21 detects, for example, a skin part of a subject and distinguishes and acquires the detected skin temperature and a non-skin temperature different from the skin part.

  The measuring device 21 includes a DSP (digital signal processor) 41, an LED (light-emitting diode) 42 a, an LED 42 b, a camera 43, and a temperature measuring unit 44. Note that the number of the LEDs 42a and the number of the LEDs 42b are not limited to one, but may be plural as necessary.

  The DSP 41 functions as a light emission control unit 61, a skin detection unit 62, and a skin temperature acquisition unit 63 by executing a control program held in a memory (not shown), for example.

  The light emission control unit 61 controls the LED 42a and the LED 42b based on the frame synchronization signal from the camera 43, and controls the turning off and lighting of the LED 42a and the LED 42b. Here, the frame synchronization signal represents the timing at which the camera 43 performs imaging.

  That is, for example, based on the frame synchronization signal from the camera 43, the light emission control unit 61 turns on only the LED 42a, turns on only the LED 42b, and turns on the LED 42a and LED 42b each time one image is captured by the camera 43. Both are repeatedly turned off.

  By the way, in the present embodiment, as shown in FIG. 1, for example, the light emission control unit 61 supplies the LED 42a and the LED 42b with a light emission control signal for controlling the turn-off and lighting so that the LED 42a and the LED 42b The LED 42b is controlled.

  The LED 42a and the LED 42b are turned on or off according to the light emission control signal from the light emission control unit 61, respectively.

  However, for example, one LED driver may be provided in the measurement device 21, and the LED 42a and the LED 42b may be configured to be turned on or off according to control from the LED driver.

  In this case, for example, the LED driver controls the LED 42 a and the LED 42 b based on the light emission control signal from the light emission control unit 61. In addition to providing one LED driver for controlling the LEDs 42a and 42b, separate LED drivers may be provided for controlling the LED 42a and for controlling the LED 42b.

  The skin detection unit 62 acquires captured images I_λ1, I_λ2, and I_off from the camera 43. Here, the captured image I_λ1 represents an image obtained by imaging by the camera 43 in a state where only the LED 42a that emits (irradiates) light having the wavelength λ1 is turned on.

  The captured image I_λ2 represents an image obtained by imaging with the camera 43 in a state where only the LED 42b that emits (irradiates) light having the wavelength λ2 is turned on. Furthermore, the captured image I_off represents an image obtained by imaging with the camera 43 in a state where both the LED 42a and the LED 42b are turned off.

  The skin detection unit 62 performs smoothing using an LPF (low pass filter) on each acquired captured image I_λ1, I_λ2, I_off. Further, the skin detection unit 62 subtracts the luminance value Y (λ2) of the captured image I_λ2 from the luminance value Y (λ1) of the captured image I_λ1 for each pixel (Y (λ1) −Y ( λ2)) is calculated.

  Further, the skin detection unit 62 uses, for example, a luminance value (Y (λ1) Y (off)) and a difference (Y (λ1) −Y (λ2)) as a value based on at least one of the captured image I_λ1 or the captured image I_λ2. Normalize (divide). Note that the luminance value Y (off) represents the luminance value of the captured image I_off.

  Then, the skin detection unit 62 multiplies the normalized difference {(Y (λ1) −Y (λ2)) / (Y (λ1) Y (off))} by a predetermined value (for example, 100). The obtained difference image I_diff (= {(I_λ1−I_λ2) / (I_λ1 I_off)} × 100) is binarized with a predetermined threshold for binarization to calculate a binarized skin image I_skin.

  Note that the difference image I_diff (= {(I_λ1-I_λ2) / (I_λ1 I_off)} × 100) indicates how much the luminance value of the captured image I_λ1 is higher than the luminance value of the captured image I_λ2. Represent. As the binarization threshold value, for example, 10% can be used.

  The skin detection unit 62 detects a skin region representing the skin of the subject based on the calculated binarized skin image I_skin.

  That is, for example, the skin detection unit 62 detects, as a skin region, a region that is equal to or greater than a binarization threshold among all regions that constitute the calculated binarized skin image I_skin. The skin detection unit 62 generates a mask image for detecting a skin region on the temperature distribution image generated by the temperature measurement unit 44 based on the detected skin region, and supplies the mask image to the skin temperature acquisition unit 63. .

  In addition, in the skin detection part 62, detecting a skin area | region from the binarized skin image I_skin has detected the area | region which is not detected as a skin area | region among the binarized skin image I_skin as a non-skin area | region. It can be said that this is an equivalent process.

  Therefore, the skin detection unit 62 detects, as a non-skin area, an area that is less than the binarization threshold among all areas that constitute the calculated binarized skin image I_skin instead of detecting the skin area. You may make it do. Then, the skin detection unit 62 may generate a mask image based on the detected non-skin region.

  The principle that the skin area of the subject can be detected in this way will be described later with reference to FIG.

  Further, when calculating the difference image I_diff, the luminance value Y (off) of the captured image I_off is used to remove the influence of external light other than the irradiation light of the LED 42a and the LED 42b, thereby improving the accuracy of skin detection. Can be improved.

  When the influence of external light is slight, the acquisition of the captured image I_off may be omitted and the difference image I_diff may be calculated.

  Further, if a visible light cut filter for cutting (blocking) visible light is provided on the front surface of the lens of the camera 43, the influence of visible light as external light can be removed, and the accuracy of skin detection can be improved. It can be improved further.

  For example, the skin temperature acquisition unit 63 detects a skin temperature region that represents a temperature distribution in the skin region of the subject from the temperature distribution image from the temperature measurement unit 44 based on the mask image from the skin detection unit 62. Get by. Details of the detection method for detecting the skin temperature region will be described later with reference to FIGS.

  Here, the temperature distribution image refers to an image representing a temperature distribution within the imaging range of the camera 43, for example. The temperature measuring unit 44 is an infrared camera typified by a thermo viewer, for example, and receives far-infrared rays emitted from a subject serving as a heat source. Then, the temperature measurement unit 44 measures the distribution of the temperature of the subject according to the intensity of the received far infrared rays, and supplies a temperature distribution image obtained according to the measurement result to the skin temperature acquisition unit 63.

  In this embodiment, it is assumed that the infrared camera and the camera 43 perform imaging within the same imaging range. However, the imaging range of the infrared camera and the camera 43 is not limited to the same imaging range, and may be an imaging range in which only a part overlaps each other.

  In this case, of the imaging range of the infrared camera, the image captured in the range overlapping the imaging range of the camera 43 is the temperature distribution image. Also, of the imaging range of the camera 32, an image captured in a range that overlaps the imaging range of the infrared camera is taken as a captured image I_λ1, I_λ2, or I_off. Note that the imaging range between the infrared camera and the camera 43 (for example, the relative positional relationship between the infrared camera and the camera 43, the angle of view, etc.) is determined in advance by calibration performed when the measuring device 21 is manufactured or used. .

  The skin temperature acquisition unit 63 outputs and displays a skin temperature image including the acquired skin temperature region on a monitor (not shown).

  The LED 42 a is turned on or off in accordance with control from the light emission control unit 61. That is, the LED 42a irradiates light of wavelength λ1 (for example, infrared light of wavelength λ1) or stops irradiating light of wavelength λ1 according to control from the light emission control unit 61.

  The LED 42b is turned on or off according to control from the light emission control unit 61. That is, the LED 42b irradiates light having a wavelength λ2 that is longer than the wavelength λ1 (for example, infrared light having a wavelength λ2) or stops irradiating light having a wavelength λ2 in accordance with control from the light emission control unit 61.

  Note that the LED 42 a and the LED 42 b irradiate at least the imaging range of the camera 43.

  Further, the combination (λ1, λ2) of the wavelength λ1 and the wavelength λ2 is determined in advance based on, for example, spectral reflection characteristics with respect to human skin. This spectral reflection characteristic will be described in detail with reference to FIG.

  The camera 43 is composed of, for example, a lens, a complementary metal oxide semiconductor (CMOS) sensor, and the like, and images a subject in accordance with a frame synchronization signal. In addition, the camera 43 supplies a frame synchronization signal to the light emission control unit 61.

  Specifically, for example, the camera 43 is a light receiving element provided in a CMOS sensor or the like, and receives the reflected light of the light having the wavelength λ1 irradiated to the subject by the LED 42a. Then, the camera 43 supplies the captured image I_λ1 obtained by photoelectrically converting the received reflected light to the skin detecting unit 62.

  Further, for example, the camera 43 is a light receiving element provided in a CMOS sensor or the like, and receives reflected light of light having a wavelength λ2 irradiated on the subject by the LED 42b. Then, the camera 43 supplies the captured image I_λ2 obtained by photoelectrically converting the received reflected light to the skin detecting unit 62.

  Further, for example, the camera 43 is a light receiving element provided in a CMOS sensor or the like, and receives reflected light from a subject in a state where neither the LED 42a nor the LED 42b is irradiating light. Then, the camera 43 supplies the captured image I_off obtained by photoelectrically converting the received reflected light to the skin detection unit 62.

  As described above, the temperature measurement unit 44 is, for example, an infrared camera, images the same imaging range as the camera 43, and supplies a temperature distribution image obtained as a result to the skin temperature acquisition unit 63.

[Example of skin temperature region detection method by skin temperature acquisition unit 63]
Next, with reference to FIG. 2 thru | or FIG. 4, the detection method of the skin part temperature area | region which the skin temperature acquisition part 63 performs is demonstrated.

  The temperature measurement unit 44 performs imaging as an infrared camera, generates a temperature distribution image representing the temperature distribution within the imaging range, and supplies the temperature distribution image to the skin temperature acquisition unit 63 as shown in FIG.

  In FIG. 2, the temperature is represented by a gray scale (gray density). In other words, the higher the temperature, the higher the density of gray (gray close to black), and the lower the temperature, the lower the density (gray close to white). For example, when expressed in black, the temperature is highest, and when expressed in white, the temperature is lowest.

  In FIG. 2, the temperature of the subject's face and hands is relatively high, and therefore, it is shown in a relatively dark gray color. In FIG. 2, since the temperature of the clothes and the background of the subject is relatively low, it is shown in white (gray having the lowest density).

  The skin detection unit 62 generates a binarized skin image I_skin as shown in FIG. 3 based on the captured images I_λ1, I_λ2, I_off from the camera 43, and based on the generated binarized skin image I_skin, Detect skin areas. The skin detection unit 62 generates a mask image based on the detected skin region and supplies the mask image to the skin temperature acquisition unit 63.

  In FIG. 3, among all the regions of the binarized skin image I_skin, the skin region is expressed in white, and the non-skin region different from the skin region is expressed in black.

  The skin temperature acquisition unit 63 detects the skin region on the temperature distribution image (FIG. 2) from the temperature measurement unit 44 based on the mask image from the skin detection unit 62 as a skin part temperature region, thereby FIG. The skin temperature image including the skin temperature region as shown in FIG. 6 is acquired and output to a monitor (not shown).

[Spectral reflection characteristics]
Next, FIG. 5 shows spectral reflection characteristics with respect to human skin.

  This spectral reflection characteristic is general regardless of the color difference (race difference) and state (sunburn, etc.) of human skin.

  In FIG. 5, the horizontal axis indicates the wavelength of the irradiation light irradiated on the human skin, and the vertical axis indicates the reflectance of the irradiation light irradiated on the human skin.

  It is known that the reflectance of irradiated light radiated on human skin decreases rapidly from around 900 [nm], peaking around 800 [nm], and rises again around 1000 [nm] as a minimum. ing.

  Specifically, for example, as shown in FIG. 5, the reflectance of reflected light obtained by irradiating human skin with light of 870 [nm] as infrared rays is about 63%. Moreover, the reflectance of the reflected light obtained by irradiating light of 950 [nm] as infrared rays is about 50 percent.

  This is peculiar to human skin, and in an object other than human skin (for example, clothing), the change in reflectance is moderate in the vicinity of 800 to 1000 [nm]. In addition, as the frequency becomes higher, it often increases gradually.

  In the present embodiment, for example, the combination (λ1, λ2) = (870,950). This combination is a combination in which the reflectance when the human skin is irradiated with light of wavelength λ1 is larger than the reflectance when the light of wavelength λ2 is irradiated.

  Therefore, the luminance value constituting the skin area on the captured image I_λ1 is a relatively large value, and the luminance value constituting the skin area on the captured image I_λ2 is a relatively small value.

  Therefore, the luminance value of the skin area on the difference image I_diff (= {(I_λ1−I_λ2) / (I_λ1 I_off)} × 100) is a relatively large positive value α1.

  Further, in the combination (λ1, λ2) = (870,950), the reflectance when irradiating light of wavelength λ1 is almost the same as the reflectance when irradiating light of wavelength λ2 to things other than human skin. Combinations that are the same.

  For this reason, the luminance value of the non-skin region on the difference image I_diff (= {(I_λ1−I_λ2) / (I_λ1 I_off)} × 100) is a relatively small positive or negative value β1.

  Therefore, the difference image I_diff is binarized with a predetermined threshold for binarization (for example, a threshold smaller than α1 and larger than β1) so as to detect the skin region. I have to.

  Here, the combination (λ1, λ2) is not limited to (λ1, λ2) = (870,950), and may be any combination as long as the difference in reflectance is sufficiently large (λ1, λ2). .

  For accurate skin detection, the wavelength λ1 is generally in the range of 640 [nm] to 1000 [nm], and the wavelength λ2 is in the range of 900 [nm] to 1100 [nm]. Thus, it is known from experiments previously conducted by the present inventor that it is desirable to set each of them.

  However, when the wavelength λ1 is a wavelength in the visible light region, the value of the wavelength λ1 is desirably 800 [nm] or more in the invisible light region because the subject feels dazzling.

  That is, for example, within the above-mentioned range, the value of wavelength λ1 is a value in the invisible light region of 800 [nm] or more and less than 900 [nm], and the value of wavelength λ2 is the invisible light region of 900 [nm] or more. Is desirable.

[Description of Operation of Measuring Device 21]
Next, the skin temperature measurement process performed by the measurement device 21 will be described with reference to the flowchart of FIG.

  This skin temperature measurement process is started, for example, when the power of the measuring device 21 is turned on.

  In step S <b> 21, the light emission control unit 61 turns on the LED 42 a in accordance with the frame synchronization signal from the camera 43 at the timing at which the camera 43 is imaged (the process of step S <b> 22). Accordingly, the LED 42a irradiates the subject with light having the wavelength λ1 while the camera 43 performs imaging. The LED 42b is turned off.

  In step S <b> 22, the camera 43 starts imaging the subject irradiated with the light from the LED 42 a, and supplies the captured image I_λ <b> 1 obtained as a result to the skin detection unit 62.

  In step S23, the light emission control unit 61 turns off the LED 42a at the timing when the imaging of the camera 43 in step S22 ends according to the frame synchronization signal from the camera 43.

  In addition, the light emission control unit 61 turns on the LED 42b at the timing when the next imaging (processing in step S24) of the camera 43 starts in accordance with the frame synchronization signal from the camera 43. Thus, the LED 42b irradiates the subject with light having the wavelength λ2 while the next imaging of the camera 43 is performed. The LED 42a is turned off.

  In step S <b> 24, the camera 43 starts imaging the subject irradiated with the light from the LED 42 b, and supplies the captured image I_λ <b> 2 obtained as a result to the skin detection unit 62.

  In step S25, the light emission control unit 61 turns off the LED 42b at the timing when the imaging of the camera 43 in step S24 ends according to the frame synchronization signal from the camera 43. As a result, both the LED 42a and the LED 42b are turned off.

  In step S <b> 26, the camera 43 starts imaging in a state where both the LED 42 a and the LED 42 b are turned off, and supplies the captured image I_off obtained as a result to the skin detection unit 62.

  In step S27, the skin detection unit 62 calculates a difference image I_diff (= {(I_λ1−I_λ2) / (I_λ1-I_off)} × 100) based on each captured image I_λ1, I_λ2, I_off from the camera 43. .

  In step S28, the skin detection unit 62 calculates a binarized skin image I_skin obtained by binarizing the calculated difference image I_diff using a predetermined threshold for binarization.

  In step S29, the skin detection unit 62 detects a skin region based on the calculated binarized skin image I_skin.

  In step S <b> 30, the skin detection unit 62 generates a mask image for detecting a skin region on the temperature distribution image based on the detected skin region, and supplies the mask image to the skin temperature acquisition unit 63.

  In step S <b> 31, the temperature measurement unit 44 performs imaging and supplies a temperature distribution image obtained as a result of the imaging to the skin temperature acquisition unit 63.

  In step S <b> 32, the skin temperature acquisition unit 63 uses the mask image from the skin detection unit 62 to detect a skin region (temperature of the skin part of the subject) on the temperature distribution image from the temperature measurement unit 44. A skin temperature image as shown in FIG. 4 is acquired.

  After the end of step S32, the process returns to step S21, and the same process is repeated thereafter. Note that this skin temperature measurement process is terminated, for example, when the power of the measuring device 21 is turned off.

  As described above, according to the skin temperature measurement process, only the skin region on the temperature distribution image is detected, and only the temperature of the skin portion of the subject can be acquired.

  For this reason, the temperature of the skin part of the subject can be acquired separately from the temperature of the non-skin part.

  Further, according to the skin temperature measurement process, the skin area of the subject is detected using the human spectral reflection characteristics as shown in FIG. Therefore, the skin region can be detected with high accuracy regardless of the brightness of the illumination that illuminates the subject.

  For this reason, for example, even when the brightness of the illumination for illuminating the subject is insufficient (dark), the skin region can be detected with high accuracy.

  In the measurement device 21, the skin temperature acquisition unit 63 detects the skin temperature image from the temperature distribution image from the temperature measurement unit 44 using the mask image from the skin detection unit 62.

  However, for example, the skin region is supplied from the skin detection unit 62 to the skin temperature acquisition unit 63, and the skin temperature acquisition unit 63 is based on the skin region from the skin detection unit 62. Thus, the direction and position where the skin portion of the subject exists may be detected. And the skin temperature acquisition part 63 may be made to acquire by measuring the temperature of the skin part which exists in the detected direction and position.

  In this case, the skin temperature acquisition unit 63 functions as a spot-type radiation thermometer that measures the temperature of an object by measuring the intensity of light rays such as infrared rays and visible rays emitted from the object. In this case, the temperature measuring unit 44 can be omitted in the measuring device 21. Furthermore, the skin temperature acquisition unit 63 detects the direction and position where the non-skin part exists based on the skin region from the skin detection unit 62, and the temperature of the non-skin part existing in the detected direction and position. Can also be obtained by measuring. In addition, the skin temperature acquisition unit 63 may detect the direction and the position where the skin part and the non-skin part exist, and separately measure the temperature of the skin part and the temperature of the non-skin part. Good.

  In addition, for example, the first mask image for detecting the skin region and the second mask for detecting the non-skin region from the skin region detected by the skin detection unit 62 based on the binarized skin image I_skin. A mask image may be generated. In this case, the skin temperature acquisition unit 63, based on the first mask image, determines the skin region (temperature of the skin part of the subject) on the temperature distribution image from the temperature measurement unit 44 based on the second mask image. The non-skin region (temperature of the non-skin part of the subject) on the temperature distribution image from the temperature measuring unit 44 can be detected separately.

  Further, for example, the skin detection unit 62 generates a second mask image from the skin region detected based on the binarized skin image I_skin. Then, the temperature acquisition unit 63 may detect a non-skin region (temperature of the non-skin part of the subject) on the temperature distribution image from the temperature measurement unit 44 based on the second mask image.

  In the measurement apparatus 21, the skin detection unit 62 detects the skin area of the subject based on the captured images I_λ1, I_λ2, and I_off. However, if the temperature distribution image is also used, skin detection is performed. The accuracy can be further improved.

  That is, for example, the skin detection unit 62 detects a partial region as a skin region based on the captured images I_λ1, I_λ2, I_off, and the temperature distribution on the detected partial region is based on the temperature distribution image. It is determined whether or not the temperature distribution of the part is. When the skin detection unit 62 determines that the detected temperature distribution on the partial area is the temperature distribution of the skin part, the skin detection unit 62 detects the partial area as the final skin area.

  When detecting a skin region in this way, the detection accuracy of the skin region can be further improved as compared with the case of detecting a skin region based on the captured images I_λ1, I_λ2, and I_off.

  For this reason, for example, if the measuring device 21 is used as an intrusion detection device for detecting an intruder, the skin of the intruder who has entered the site can be detected more accurately. Reliability can be improved.

  Note that the measuring device 21 can be used as a measuring device that measures the body temperature of a plurality of patients at a time, for example, as the temperature of the skin of a subject in the medical field. In this case, for example, the measuring device 21 is provided on the ceiling of a hospital room where a plurality of patients sleep.

  If invisible light is used as the light of wavelength λ1 and the light of wavelength λ2 in the measuring device 21, the body temperature can be measured even in a dark environment, so the patient's body temperature can be easily measured even when the patient's room is turned off. Can do.

  In addition, the measurement device 21 detects a change in the measured body temperature of the patient, and controls the air conditioner (for example, an air conditioner) provided in the hospital room according to the detection result to manage the temperature in the hospital room. It can be set as the air-conditioning control apparatus. Specifically, for example, the skin temperature acquisition unit 63 of the measurement device 21 controls the air conditioning in response to detecting that the patient's body temperature is decreasing, and increases the temperature in the sickroom.

  In the measurement device 21, in addition to air conditioning management, in the captured image, for example, the patient has fallen from the bed or the like in response to the detection of the area below the bed (floor side) as the skin area, for example. May be detected.

  Furthermore, the measurement device 21 may be provided in a bathroom or the like, and the skin temperature acquisition unit 63 may measure the body temperature of the subject during bathing. And the skin temperature acquisition part 63 can detect the change of the body temperature of a to-be-photographed object, and can output the information according to the detection result from the monitor and speaker which are not shown in figure.

  That is, for example, when the skin temperature acquisition unit 63 determines that the subject is likely to rise in accordance with the change in the measured body temperature, information such as “Let's get hot, let's get out of the bathtub once” It can be output from a monitor or speaker (not shown).

  Moreover, the measuring device 21 can be used as a device for measuring the body temperature of a subject during exercise. The skin temperature acquisition unit 63 measures the body temperature of the subject during exercise, and outputs the calorie consumption state from a monitor or speaker (not shown) according to the measured body temperature rise (the state of change in body temperature) or the like. To do. The skin temperature acquisition unit 63 detects the calorie consumption state based on the fact that the calorie is easily consumed as the body temperature rises, and as a result, the body fat is also easily burned. Output from a monitor or speaker.

  Furthermore, for example, the skin temperature acquisition unit 63 can detect a change in body temperature of the subject during exercise, and can direct efficient exercise to the subject according to the detection result.

  Moreover, since the measuring device 21 can measure the body temperature of each of a plurality of subjects, it can be provided, for example, in a sports gym. In the measurement apparatus 21, an infrared camera as the temperature measurement unit 44 is used to generate a temperature distribution image. However, only the body temperature region of the skin part is detected and output to a monitor or the like using a mask image. To do. For this reason, the clothes of the subject do not show through on the monitor or the like.

  Further, in the measurement device 21, the skin region detected by the skin detection unit 62 is identified based on the detected temperature to indicate which skin portion of the subject, and based on the identification result, the gesture or posture of the subject is identified. Etc. can be detected. This makes use of the fact that human body temperature varies depending on parts such as the face and hands.

  Therefore, the subject can perform a gesture operation, a posture operation, or the like using the measurement device 21.

  The measuring device 21 can also be used as an alarm device that warns (warns) the degree of danger such as heat stroke. That is, for example, the skin temperature acquisition unit 63 compares the acquired body temperature of the skin part of the subject and the outside air temperature, and determines the risk of heat stroke from a relationship between the body temperature and the outside air temperature by using a monitor (not shown) Output from a speaker or the like.

  Specifically, for example, the skin temperature acquisition unit 63 sounds an alarm alarm when detecting that the temperature of the skin portion of the subject is rapidly rising.

  As the outside air temperature, the skin temperature acquisition unit 63 acquires the temperature of the non-skin part by detecting the non-skin area on the temperature distribution image based on the skin area, and averages the acquired non-skin part. Temperature is used in a pseudo manner.

  In addition, for example, as the outside air temperature, a thermistor or the like may be provided in the measuring device 21, and the outside air temperature may be acquired by the thermistor or the like.

<2. Modification>
In the present embodiment, only the skin temperature region is detected from the temperature distribution image, but a region that satisfies a predetermined condition may be detected from the detected skin temperature region.

  That is, for example, the skin temperature acquisition unit 63 is configured to detect, from the detected skin temperature region, a region that is equal to or higher than the first temperature, a region that is less than the second temperature, or a region that is a temperature within a predetermined range. At least one may be detected. Note that the first temperature, the second temperature, or the predetermined range is determined in advance by the user as the subject, for example, by the operation unit (not shown) in the measurement device 21.

  In the present embodiment, the skin temperature acquisition unit 63 detects only the skin region on the temperature distribution image based on the skin region from the skin detection unit 62. However, for example, based on the skin region, for example. Alternatively, only the non-skin area excluding the skin area on the temperature distribution image may be detected and acquired.

  In the present embodiment, the skin temperature acquisition unit 63 detects only the skin region on the temperature distribution image based on the skin region from the skin detection unit 62. However, for example, the skin temperature acquisition unit 63 can acquire a temperature that satisfies a predetermined condition from the skin region (the temperature of the skin part of the subject) on the temperature distribution image.

  That is, for example, the skin temperature acquisition unit 63 determines the maximum skin temperature, the minimum skin temperature, or the skin area from the skin area on the temperature distribution image, that is, the skin temperature distribution of the subject. At least one of the average values of the temperatures can be obtained.

  The skin temperature acquisition unit 63 can output the acquired maximum value, minimum value, average value, or the like to a monitor or speaker (not shown). As a result, the maximum value, minimum value, average value, or the like of the skin portion of the subject can be easily monitored.

  In addition, for example, as described above, when the measurement device 21 is used in a hospital room, a bathroom, a gym, or the like, or when used as an intrusion detection device or an alarm device, the temperature of the skin (body temperature), The acquired maximum value, minimum value, average value, or the like can be used.

  In the measuring device 21, the LED 42a and the LED 42b may be separately prepared as lighting devices. In this case, in the measuring apparatus 21, it is not necessary to provide the LED 42a and the LED 42b.

In addition, this technique can also take the following structures.
(1) An imaging unit that images a subject, a first captured image obtained by imaging when the subject is irradiated with light having a first wavelength, and the first wavelength with respect to the subject A skin detection unit for detecting a skin region representing the skin part of the subject based on a second captured image obtained by imaging when irradiating light of a second wavelength that is longer than the wavelength; and the skin A measurement device including a temperature acquisition unit that acquires at least one of a temperature of the skin part or a temperature of a non-skin part different from the skin part based on a region.
(2) It further includes a generation unit that generates a temperature distribution image representing a temperature distribution within a range where the subject exists, and the temperature acquisition unit is configured to extract the skin portion from the temperature distribution image based on the skin region. The measuring device according to (1), which is acquired by detecting at least one of the temperature of the non-skin part or the temperature of the non-skin part.
(3) The measuring apparatus according to (2), further including a conditional temperature acquisition unit that acquires a temperature that satisfies a predetermined condition from the temperature of the skin part.
(4) The condition temperature acquisition unit acquires at least one of the maximum value of the skin part, the minimum value of the skin part, or the average value of the temperature of the skin part from the temperature of the skin part. The measuring device according to (3).
(5) The measuring apparatus according to (2), further including a condition region detection unit that detects, from the temperature distribution image, a skin distribution region that represents a temperature distribution satisfying a predetermined condition among the temperatures of the skin portion. .
(6) The condition area detection unit is set to be less than a second temperature of the first skin part distribution area and the skin part temperature, which are set to be equal to or higher than the first temperature among the skin part temperatures. The measurement according to (5), wherein at least one of the second skin distribution region or the third skin distribution region which is set to a temperature within a predetermined range among the temperature of the skin portion is detected. apparatus.
(7) The temperature acquisition unit is configured to detect the temperature of the skin part or the non-skin part based on the intensity of light emitted from at least one of the skin part or the non-skin part detected based on the skin area. The measuring device according to (1), which is obtained by measuring at least one of the temperatures.
(8) The change detection unit that detects a change in the temperature based on the temperature acquired by the temperature acquisition unit, and an execution unit that executes a process according to the detection result of the change detection unit. The measuring apparatus according to 1).
(9) The apparatus further includes a first irradiating unit that irradiates the subject with light having the first wavelength, and a second irradiating unit that irradiates the subject with light having the second wavelength. (1) thru | or the measuring apparatus as described in (8).
(10) In a measurement method of a measurement apparatus including an imaging unit that captures an image of a subject, a first captured image obtained by imaging when the subject is irradiated with light of a first wavelength by the measurement device , And a skin portion of the subject based on a second captured image obtained by imaging when the subject is irradiated with light having a second wavelength that is longer than the first wavelength. A measurement method comprising: a skin detection step of detecting a skin region; and a temperature acquisition step of acquiring at least one of a temperature of the skin portion or a temperature of a non-skin portion different from the skin portion based on the skin region.
(11) A first captured image obtained by imaging when a computer of a measurement apparatus including an imaging unit that performs imaging of a subject is irradiated with light having a first wavelength on the subject, and the subject Skin for detecting a skin region representing a skin portion of the subject based on a second captured image obtained by imaging when light having a second wavelength that is longer than the first wavelength is irradiated. The program for functioning as a temperature acquisition part which acquires at least one of the temperature of the said skin part, or the temperature of the non-skin part different from the said skin part based on a detection part and the said skin area | region.

  By the way, the above-described series of processing can be executed by hardware or can be executed by software. When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a program recording medium in a general-purpose computer or the like.

[Computer configuration example]
FIG. 7 shows an example of the hardware configuration of a computer that executes the above-described series of processing by a program.

  A CPU (Central Processing Unit) 201 executes various processes according to a program stored in a ROM (Read Only Memory) 202 or a storage unit 208. A RAM (Random Access Memory) 203 appropriately stores programs executed by the CPU 201, data, and the like. These CPU 201, ROM 202, and RAM 203 are connected to each other by a bus 204.

  An input / output interface 205 is also connected to the CPU 201 via the bus 204. Connected to the input / output interface 205 are an input unit 206 composed of a keyboard, a mouse, a microphone, and the like, and an output unit 207 composed of a display, a speaker, and the like. The CPU 201 executes various processes in response to commands input from the input unit 206. Then, the CPU 201 outputs the processing result to the output unit 207.

  A storage unit 208 connected to the input / output interface 205 includes, for example, a hard disk, and stores programs executed by the CPU 201 and various data. The communication unit 209 communicates with an external device via a network such as the Internet or a local area network.

  Further, a program may be acquired via the communication unit 209 and stored in the storage unit 208.

  The drive 210 connected to the input / output interface 205 drives a removable medium 211 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and drives programs and data recorded there. Etc. The acquired program and data are transferred to and stored in the storage unit 208 as necessary.

  As shown in FIG. 7, a recording medium for recording (storing) a program that is installed in a computer and can be executed by the computer includes a magnetic disk (including a flexible disk), an optical disk (CD-ROM (Compact Disc- Removable media 211, which is a package media made up of read only memory), DVD (digital versatile disc), magneto-optical disc (including MD (mini-disc)), or semiconductor memory, or the program is temporarily or It is composed of a ROM 202 that is permanently stored, a hard disk that constitutes the storage unit 208, and the like. Recording of a program on a recording medium is performed using a wired or wireless communication medium such as a local area network, the Internet, or digital satellite broadcasting via a communication unit 209 that is an interface such as a router or a modem as necessary. Is called.

  In the present specification, the steps describing the series of processes described above are not limited to the processes performed in time series according to the described order, but are not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.

  The embodiments in the present disclosure are not limited to the above-described embodiments, and various modifications can be made without departing from the gist of the present disclosure.

  21 measurement device, 41 DSP, 42a, 42b LED, 43 camera, 44 temperature measurement unit, 61 light emission control unit, 62 skin detection unit, 63 skin temperature acquisition unit

Claims (11)

An imaging unit for imaging a subject;
A first captured image obtained by imaging when the subject is irradiated with light having a first wavelength, and light having a second wavelength that is longer than the first wavelength with respect to the subject. A skin detection unit that detects a skin region representing the skin part of the subject based on a second captured image obtained by imaging when irradiating
And a temperature acquisition unit that acquires at least one of a temperature of the skin part or a temperature of a non-skin part different from the skin part based on the skin region. A generator for generating a temperature distribution image representing a temperature distribution within a range where the subject exists;
The measurement apparatus according to claim 1, wherein the temperature acquisition unit acquires, based on the skin region, by detecting at least one of a temperature of the skin part or a temperature of the non-skin part from the temperature distribution image. . The measurement apparatus according to claim 2, further comprising a condition temperature acquisition unit that acquires a temperature that satisfies a predetermined condition from the temperature of the skin part. The condition temperature acquisition unit acquires at least one of a maximum value of the skin part temperature, a minimum value of the skin part temperature, or an average value of the skin part temperature from the temperature of the skin part. 3. The measuring device according to 3. The measurement apparatus according to claim 2, further comprising a condition region detection unit that detects, from the temperature distribution image, a skin portion distribution region that represents a temperature distribution satisfying a predetermined condition among the temperatures of the skin portion. The condition area detection unit is a first skin part distribution area that is set to be equal to or higher than a first temperature among the temperature of the skin part, and a second temperature that is less than a second temperature among the temperature of the skin part. The measurement apparatus according to claim 5, wherein at least one of the skin part distribution region or the third skin part distribution region that is set to a temperature within a predetermined range is detected from the skin part temperature. The temperature acquisition unit is configured to determine the temperature of the skin part or the temperature of the non-skin part based on the intensity of light emitted from at least one of the skin part or the non-skin part detected based on the skin region. The measurement apparatus according to claim 1, wherein the measurement apparatus is obtained by measuring at least one of the two. Based on the temperature acquired by the temperature acquisition unit, a change detection unit that detects a change in the temperature,
The measurement apparatus according to claim 1, further comprising: an execution unit that executes a process according to a detection result of the change detection unit. A first irradiation unit that irradiates the subject with light of the first wavelength;
The measurement apparatus according to claim 1, further comprising: a second irradiation unit configured to irradiate the subject with light having the second wavelength. In a measuring method of a measuring apparatus including an imaging unit that images a subject,
According to the measuring device,
A first captured image obtained by imaging when the subject is irradiated with light having a first wavelength, and light having a second wavelength that is longer than the first wavelength with respect to the subject. A skin detection step of detecting a skin region representing the skin portion of the subject based on a second captured image obtained by imaging when irradiating
A temperature acquisition step including acquiring at least one of a temperature of the skin part or a temperature of a non-skin part different from the skin part based on the skin region. A computer of a measuring device including an imaging unit for imaging a subject,
A first captured image obtained by imaging when the subject is irradiated with light having a first wavelength, and light having a second wavelength that is longer than the first wavelength with respect to the subject. A skin detection unit that detects a skin region representing the skin part of the subject based on a second captured image obtained by imaging when irradiating
The program for functioning as a temperature acquisition part which acquires at least one of the temperature of the said skin part based on the said skin area | region, or the temperature of the non-skin part different from the said skin part.

Images