JP2015054224A - Heat attack determination device, portable terminal device, heat attack determination method, and heat attack determination program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a heat attack determination device, a portable terminal device, a heat attack determination method, and a heat attack determination program, which make it possible to detect a heat attack without additional hardware.SOLUTION: A portable terminal device 10 calculates a first index from at least one of a temperature and a humidity taken by a sensor 11. The portable terminal device 10 detects a pulse rate from an image taken by a camera 13. The portable terminal device 10 determines whether or not there is onset possibility of a heat attack by using the first index and the pulse rate. The portable terminal device 10 indicates a determination result.

Description

  The present invention relates to a heat stroke determination device, a portable terminal device, a heat stroke determination method, and a heat stroke determination program.

  Hot summer days (such as midsummer days) are increasing due to the effects of global warming. For this reason, for example, the number of heat stroke occurrences of students under school management has increased, and the number of elderly heat stroke patients in daily life has increased. Generally, heat stroke is likely to occur in a hot and humid environment, but may occur when the humidity is high even in a relatively low temperature state. When the humidity is high and the temperature is low, there are many cases in which heat stroke develops without the person being aware. For example, an elderly person may not be aware of heat due to a decrease in skin temperature sensitivity, delaying body temperature regulation, and delaying increases in skin blood flow and sweating as the body temperature rises. For this reason, an elderly person tends to rise in body temperature and to become heat stroke.

  As an example of a method for predicting the onset of heat stroke, we measure wet bulb black bulb temperature (WBGT: Wet-Bulb Globe Temperature (unit: ° C)), and the risk of heat stroke based on this value There is a method to evaluate. Hereinafter, the wet bulb black bulb temperature may be referred to as “WBGT”. The WBGT is sometimes called a “heat index” or “heatstroke index”.

  The “WBGT” is a value calculated from measured values of the dry bulb temperature, wet bulb temperature, and black bulb temperature, and is used as, for example, a heat index for evaluating thermal stress due to a hot environment. WBGT is standardized as ISO 7243 (1989) / JIS Z8504 (1999). Such WBGT means that the higher the value, the higher the possibility of developing heat stroke. Depending on the value of WBGT, measures for people in a certain environment are given by national guidelines. This guideline includes, for example, “heat stroke prevention guidelines in daily life” Ver. 1 (2008. 4). In this guideline, a guideline of daily activities and precautions for which attention is recommended are shown according to the WBGT value in daily life.

  In addition, the value of WBGT can be calculated from, for example, the temperature and humidity even when the black sphere temperature cannot be measured. “The Heat Stroke Prevention Guidelines in Daily Life” Ver. 1 (2008. 4), based on the temperature (unit: ° C.) and the relative humidity (%) measured by the dry bulb thermometer, it is possible to obtain caution information regarding heat stroke.

  A portable device that uses this mechanism to calculate a WBGT converted value from temperature and humidity and predicts the risk of developing heat stroke is known.

  In addition, a technique has been proposed in which the user's vitals are used to determine heat stroke. For example, there is a technique for detecting the occurrence of heat stroke by attaching a monitoring terminal connected to a sensor to protective clothing, measuring and transmitting body temperature and heart rate, and calculating the value of WBGT with the transmitted external management device. . There is also a technique for detecting, predicting, or warning the occurrence of heat stroke using an earplug-type deep body temperature and heart rate measurement sensor. There is also a technique for detecting the occurrence of heat stroke based on information on temperature, humidity, deep body temperature, and heart rate by connecting a portable device with a temperature and humidity sensor to an earplug type deep body temperature and heart rate sensor.

JP 2009-108451 A JP 2010-131209 A JP 2012-187127 A

“Heatstroke Index Monitor AD-5589 (Miharinbo Mini)”, [online], A & D, Inc. [searched August 26, 2013], Internet <URL: http: //www.aandd .co.jp / adhome / products / sp / ad5689.html>

  However, the above technique cannot detect heat stroke without extra hardware.

  That is, when determining heat stroke using WBGT, an erroneous determination may occur. This is because temperature and humidity sensations vary from person to person, for example, even when WBGT is calculated high, it is not always heat stroke, and because WBGT is calculated low, it is not always normal. .

  When using vitals to determine heat stroke, heart rate, etc. using dedicated hardware that users do not use or wear in daily life, such as protective clothing or earplug sensors Of vitals are collected. For this reason, when determining heat stroke using vitals, heat stroke cannot be detected unless dedicated hardware is used.

  In one aspect, an object of the present invention is to provide a heat stroke determination device, a portable terminal device, a heat stroke determination method, and a heat stroke determination program that can detect heat stroke without extra hardware.

  One aspect of the heat stroke determination apparatus includes an index calculation unit that calculates a first index from at least one of temperature and humidity collected by a sensor, and a pulse rate detection unit that detects a pulse rate from an image captured by a camera. A heat stroke determination unit that determines whether or not there is a possibility of developing heat stroke using the first index calculated by the index calculation unit and the pulse rate detected by the pulse rate detection unit; And a notification unit for notifying the determination result by the heat stroke determination unit.

  Heat stroke can be detected without extra hardware.

FIG. 1 is a block diagram illustrating a functional configuration of the mobile terminal device according to the first embodiment. FIG. 2 is a diagram illustrating an example of a correspondence relationship between temperature and humidity and WBGT. FIG. 3 is a diagram illustrating an example of guidelines for heat stroke prevention measures during daily life. FIG. 4 is a diagram illustrating an example of the spectrum of each signal of the G signal and the R signal. FIG. 5 is a diagram illustrating an example of a spectrum of each signal of the R component multiplied by the G component and the correction coefficient k. FIG. 6 is a diagram illustrating an example of a spectrum after calculation. FIG. 7 is a block diagram showing a functional configuration of the pulse rate detection unit. FIG. 8 is a flowchart illustrating a procedure of heat stroke determination processing according to the first embodiment. FIG. 9 is a block diagram illustrating a functional configuration of the mobile terminal device according to the second embodiment. FIG. 10 is a flowchart illustrating a procedure of heat stroke determination processing according to the second embodiment. FIG. 11 is a block diagram illustrating a functional configuration of the mobile terminal device according to the third embodiment. FIG. 12 is a block diagram illustrating a functional configuration of the blood flow rate calculation unit. FIG. 13 is a flowchart illustrating a procedure of heat stroke determination processing according to the third embodiment. FIG. 14 is a block diagram illustrating a functional configuration of the mobile terminal device according to the fourth embodiment. FIG. 15 is a flowchart illustrating a procedure of threshold setting processing according to the fourth embodiment. FIG. 16 is a flowchart illustrating a procedure of heat stroke determination processing according to the fourth embodiment. FIG. 17 is a schematic diagram illustrating an example of a computer that executes a heat stroke determination program according to the first to fifth embodiments.

  Embodiments of a heat stroke determination device, a mobile terminal device, a heat stroke determination method, and a heat stroke determination program disclosed in the present application will be described below in detail with reference to the drawings. Note that this embodiment does not limit the disclosed technology. Each embodiment can be appropriately combined within a range in which processing contents are not contradictory.

[Configuration of mobile terminal device]
First, the functional configuration of the mobile terminal device according to the first embodiment will be described. FIG. 1 is a block diagram illustrating a functional configuration of the mobile terminal device according to the first embodiment. The mobile terminal device 10 shown in FIG. 1 is detected from an image taken by a subject without bringing a measuring instrument into contact with a living body under general environmental light such as sunlight or room light, together with WBGT obtained from temperature and humidity. The risk of developing heat stroke is determined using the pulse rate. “WBGT” here is an abbreviation of so-called wet bulb black temperature “Wet-Bulb Globe Temperature”, and is sometimes called “heat index” or “heat stroke index”.

  As one aspect, the mobile terminal device 10 can be implemented by installing a heat stroke determination program provided as package software or online software on a desired computer. For example, the heat stroke determination program is installed in a mobile communication terminal that can be connected to a mobile communication network such as a smartphone, a mobile phone, or a PHS (Personal Handyphone System). Moreover, you may install the said heat stroke determination program not only in the mobile communication terminal connectable to a mobile communication network but in the digital camera and tablet terminal which do not have the capability to connect to a mobile communication network. As a result, a mobile terminal such as a mobile communication terminal or a tablet terminal can function as the mobile terminal device 10. Here, although the portable terminal is illustrated as an example of implementation of the portable terminal device 10, the heat stroke determination program can be installed in a stationary terminal device such as a personal computer.

  As illustrated in FIG. 1, the mobile terminal device 10 according to the first embodiment includes a sensor 11, an index calculation unit 12, a camera 13, an imaging control unit 14, a pulse rate detection unit 15, and a heat stroke determination unit 16. And a notification unit 17. Note that the mobile terminal device 10 may include various functional units included in known mobile terminal devices in addition to the functional units illustrated in FIG. 1. For example, the mobile terminal device 10 further includes functional units such as an input / output device such as a touch panel and a display, an antenna, a wireless communication unit that performs connection with a mobile communication network, a GPS (Global Positioning System) receiver, and an acceleration sensor. You may have it.

  The sensor 11 detects, for example, temperature and humidity. As the sensor 11, a temperature sensor, a humidity sensor, or the like can be adopted, and a sensor mounted on a portable terminal device can be used as it is. The temperature and humidity data detected by the sensor 11 is input to the index calculation unit 12. Note that the sensor 11 may detect only one of temperature and humidity.

  The index calculation unit 12 calculates a first index from temperature and humidity data detected by the sensor 11, for example. As an example of the “first index” mentioned here, the above WBGT can be cited. Such WBGT can be converted from the temperature and humidity even when the black sphere temperature cannot be measured.

  FIG. 2 is a diagram illustrating an example of a correspondence relationship between temperature and humidity and WBGT. FIG. 2 shows a temperature zone where WBGT is lower than 25 ° C., a temperature zone where WBGT is 25 ° C. or higher and lower than 28 ° C., a temperature zone where WBGT is 28 ° C. or higher and lower than 31 ° C., and a temperature zone where WBGT is 31 ° C. or higher. These four temperature zones are distinguished and displayed by painting. As shown in FIG. 2, a case is assumed where the temperature detected by the sensor 11 is 33 ° C. and the humidity is 70%. In this case, the value “32 ° C.” corresponding to the temperature “33 ° C.” and the humidity “70%” is derived as WBGT by the index calculation unit 12. As described above, the index calculation unit 12 can convert the value corresponding to the combination of the temperature and the humidity detected by the sensor 11 into the WBGT from the table showing the correspondence relationship in FIG.

  FIG. 3 is a diagram illustrating an example of guidelines for heat stroke prevention measures during daily life. As shown in FIG. 3, the temperature zone in which WBGT is less than 25 ° C. is classified into the “caution” category, and there is a risk that the heat stroke may develop due to a strong daily behavior. For example, it has been pointed out that there is a risk of onset during intense exercise or hard work. In addition, the temperature range in which WBGT is 25 ° C. or more and less than 28 ° C. is classified into the “warning” category, and there is a risk that it may develop due to moderate or higher living behavior. For example, it has been pointed out that regular and sufficient rest is taken in when exercising or working hard. Moreover, the temperature range where WBGT is 28 degreeC or more and less than 31 degreeC is classified into the category of "strict alert", and the danger which can develop by all living behavior is pointed out. For example, it has been pointed out that avoiding hot weather when going out and paying attention to an increase in room temperature indoors. Furthermore, the temperature range in which WBGT is 31 ° C. or higher is classified into a “danger” category, and it is pointed out that there is a risk that it can develop in all living activities. For example, it has been pointed out that elderly people have a risk of developing even in a resting state, avoiding going out as much as possible, and moving to a cool room.

  The index calculation unit 12 stores, for example, the table shown in FIG. 2, that is, the correspondence relationship between temperature and humidity and WBGT, and derives the value of WBGT corresponding to the combination of temperature and humidity detected by the sensor 11.

  In addition, although the case where the index calculation unit 12 calculates the first index using both temperature and humidity is illustrated here, the index calculation unit 12 calculates the temperature or humidity detected by the sensor 11. The first index may be calculated by narrowing down.

  Returning to FIG. 1, the camera 13 is an imaging device on which an imaging element such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) is mounted. For example, the camera 13 can be equipped with three or more light receiving elements such as R (red), G (green), and B (blue). The camera 13 may be disposed at any position on the side where the display is present.

  For example, an in-camera mounted on the side of the mobile terminal device 10 on which a display (not shown) is provided can be used as the camera 13. Such a camera 13 places the display side of the mobile terminal device 10 in an imaging range, and images a subject existing in the imaging range. As described above, when the in-camera is used as the camera 13, the in-camera is provided on the same surface as the display side (not shown), so that the face of the user of the mobile terminal device 10 viewing the display can be imaged. It is highly probable. In this case, detection of the pulse rate described later can be executed under the assumption that the image captured by the camera 13 includes the face of the user of the mobile terminal device 10. In addition, although the case where an in-camera is used as the camera 13 is illustrated here, an out-camera provided on the back surface of the mobile terminal device 10, that is, when the surface on which the display is installed is used as the front surface may be employed. it can.

  The imaging control unit 14 is a processing unit that executes imaging control of the camera 13. As one aspect, the imaging control unit 14 controls a trigger that causes the camera 13 to start imaging. The trigger that causes the camera 13 to start imaging may be any trigger. For example, the imaging control unit 14 controls the camera 13 so that the imaging is always performed when the power of the mobile terminal device 10 is ON, or imaging is started on time, such as 12:00, 18:00, or 24:00. It is good as well. When an image is captured by the camera 13 in this way, a moving image encoded by a predetermined compression encoding method may be output, or each still image in which a user's face is captured is acquired. It is good as well. The image output by the camera 13 is input to the pulse rate detection unit 15.

  The pulse rate detector 15 detects the pulse rate based on the image captured by the camera 13. Here, as an example, it is assumed that the face of the user of the mobile terminal device 10 is captured by the camera 13, but a part of the user's living body, for example, a skin part is included in a part of the imaging range. The image may be an image in which parts other than the face, such as fingers, hands, and feet, are captured. Although the case where the image is captured by the camera 13 and input to the pulse rate detection unit 15 is illustrated here, the image acquisition path is not limited to the path input from the camera 13. For example, an image stored in an auxiliary storage device such as a flash memory or a hard disk (not shown) or a removable medium such as a memory card can be acquired, or an image can be acquired from an external device via a network.

  The pulse rate detection unit 15 performs a process of extracting a living body region in which a living body is reflected from an image captured by the camera 13. For example, each time an image is input from the camera 13, the pulse rate detection unit 15 performs image processing such as template matching on the image, thereby performing predetermined face parts such as the user's eyes, nose, lips, and cheeks. Extract facial regions including hair and hair.

  After extracting the face area, the pulse rate detection unit 15 performs a predetermined statistical process on the pixel value of each pixel included in the face area. For example, the pulse rate detection unit 15 averages the pixel value of each pixel included in the face region for each wavelength component. In addition to the average value, the median value and the mode value may be calculated. In addition to the weighted average, an arbitrary average process such as a weighted average or a moving average may be executed. As a result, an average value of pixel values of each pixel included in the face area is calculated for each wavelength component as a representative value representing the face area.

  The pulse rate detection unit 15 cancels the components of a specific frequency band other than the pulse wave frequency band in which the pulse wave can be taken between the wavelength components from the representative value signal for each wavelength component of each pixel included in the face region. The waveform of the received signal is detected. “Pulse wave” as used herein refers to fluctuations in blood volume and includes so-called pulse rate, heart rate, and the like.

  As one aspect, the pulse rate detection unit 15 is a representative of two wavelength components of three wavelength components included in an image, for example, R component, G component, and B component, which have different absorption characteristics of blood among R component, G component, and B component. The pulse waveform of the face is detected using the time series data of values.

  To explain this, there are capillaries on the face surface, and when the blood flow flowing through the blood vessels changes due to the heartbeat, the amount of light absorbed by the bloodstream also changes according to the heartbeat. The brightness that is produced also changes with the heartbeat. Although the amount of change in luminance is small, when the average luminance of the entire face region is obtained, the time-series data of luminance includes a pulse wave component. However, the luminance also changes due to body movement in addition to the pulse wave, and this becomes a noise component of pulse wave detection, so-called body movement artifact. Therefore, a pulse wave is detected at two or more wavelengths having different light absorption characteristics of blood, for example, a G component having a high light absorption characteristic (about 525 nm) and an R component having a low light absorption characteristic (about 700 nm). Since the heart rate is in the range of 30 bpm (beats per minute) to 240 bpm when converted to 0.5 Hz to 4 Hz per minute, the other components can be regarded as noise components. Assuming that noise does not have wavelength characteristics or is minimal even if it is present, components other than 0.5 Hz to 4 Hz should be equal between the G signal and the R signal. Is different. Therefore, by correcting the sensitivity difference between components other than 0.5 Hz to 4 Hz and subtracting the R component from the G component, the noise component can be removed and only the pulse wave component can be extracted.

  For example, the G component and the R component can be represented by the following formula (1) and the following formula (2). “Gs” in the following equation (1) indicates the pulse wave component of the G signal, “Gn” indicates the noise component of the G signal, and “Rs” in the following equation (2) indicates the R signal. “Rn” indicates the noise component of the R signal. Further, since the noise component has a sensitivity difference between the G component and the R component, the correction coefficient k for the sensitivity difference is expressed by the following equation (3).

  Ga = Gs + Gn (1)

  Ra = Rs + Rn (2)

  k = Gn / Rn (3)

  When the sensitivity difference is corrected and the R component is subtracted from the G component, the pulse wave component S is expressed by the following equation (4). When this is transformed into the formula represented by Gs, Gn, Rs and Rn using the above formula (1) and the above formula (2), the following formula (5) is obtained, and further, the above formula (3 ) To eliminate the correction coefficient k and rearrange the equations, the following equation (6) is derived.

  S = Ga-kRa (4)

  S = Gs + Gn−k (Rs + Rn) (5)

  S = Gs− (Gn / Rn) Rs (6)

  Here, the G signal and the R signal have different light absorption characteristics, and Gs> (Gn / Rn) Rs. Therefore, the pulse wave component S from which noise is removed can be calculated by the above equation (6).

  FIG. 4 is a diagram illustrating an example of the spectrum of each signal of the G signal and the R signal. The vertical axis of the graph shown in FIG. 4 indicates the signal intensity, and the horizontal axis indicates the frequency (bpm). As shown in FIG. 4, since the sensitivity of the image sensor differs between the G component and the R component, the signal strengths of the two differ. On the other hand, in both the R component and the G component, there is no change in that noise appears outside the range of 30 bpm to 240 bpm, particularly in a specific frequency band of 3 bpm or more and less than 20 bpm. For this reason, as shown in FIG. 4, the signal intensity corresponding to the specified frequency Fn included in the specific frequency band of 3 bpm or more and less than 20 bpm can be extracted as Gn and Rn. The sensitivity difference correction coefficient k can be derived from these Gn and Rn.

  FIG. 5 is a diagram illustrating an example of a spectrum of each signal of the R component multiplied by the G component and the correction coefficient k. In the example of FIG. 5, the result of multiplying the absolute value of the correction coefficient is shown for convenience of explanation. Also in the graph shown in FIG. 5, the vertical axis indicates the signal intensity, and the horizontal axis indicates the frequency (bpm). As shown in FIG. 5, when the spectrum of each signal of the G component and the R component is multiplied by the correction coefficient k, the sensitivity is uniform between the components of the G component and the R component. In particular, the spectrum signal intensity in a specific frequency band is almost the same in most spectrum signals. On the other hand, in the peripheral region 400 of the frequency where the pulse wave is actually included, the signal intensity of the spectrum is not uniform between the G component and the R component.

  FIG. 6 is a diagram illustrating an example of a spectrum after calculation. In FIG. 6, the scale of the signal intensity, which is the vertical axis, is enlarged from the viewpoint of improving the visibility of the frequency band in which the pulse wave appears. As shown in FIG. 6, when the spectrum of the R signal after the multiplication of the correction coefficient k is subtracted from the spectrum of the G signal, a signal in which a pulse wave appears due to a difference in light absorption characteristics between the G component and the R component. It can be seen that the noise component is reduced with the strength of the component maintained as much as possible. In this way, it is possible to detect a pulse wave waveform from which only noise components have been removed.

  Next, the functional configuration of the pulse rate detection unit 15 will be described more specifically. FIG. 7 is a block diagram showing a functional configuration of the pulse rate detection unit 15. As shown in FIG. 7, the pulse rate detection unit 15 includes a region extraction unit 150, representative value calculation units 151R and 151G, BPF (Band-Pass Filter) 152R and 152G, extraction units 153R and 153G, and LPF ( Low-Pass Filter) 154R and 154G. Furthermore, the pulse rate detection unit 15 includes a calculation unit 155, BPFs 156R and 156G, a multiplication unit 157, a calculation unit 158, and a detection unit 159. In the example of FIGS. 4 to 6, the example in which the pulse wave is detected in the frequency domain has been described. However, in FIG. The functional structure in the case of detecting the pulse wave by canceling is shown.

  Among these, the region extraction unit 150 is a processing unit that extracts a living body region in which a living body is reflected from an image captured by the camera 13. As one aspect, each time an image is input from the camera 13, the region extraction unit 150 performs image processing such as template matching on the image, thereby performing predetermined face parts such as the user's eyes, nose, and lips. Extract facial regions including cheeks and hair. Thereafter, the region extraction unit 150 outputs the R component pixel value of each pixel included in the face region to the representative value calculation unit 151R, and the G component pixel value of each pixel included in the face region as a representative value. Output to calculation unit 151G.

  The representative value calculation units 151R and 151G are processing units that calculate the representative value of the pixel value of each pixel included in the face area. The representative value calculation unit 151R and the representative value calculation unit 151G perform the same processing except that the wavelength component for calculating the representative value is different from the R component or the G component. Here, as an example, the calculation of the representative value by the representative value calculation unit 151G will be described. For example, the representative value calculation unit 151G averages the pixel values of the G component of each pixel included in the face area. In addition to the average value, the median value and the mode value may be calculated. In addition to the weighted average, an arbitrary average process such as a weighted average or a moving average may be executed. Thus, the average value of the G component pixel values of each pixel included in the face area is calculated as the representative value of the G component representing the face area.

  Thereafter, time-series data of the R signal having the representative value of the R component pixel value of each pixel included in the face area as a signal value is input to the subsequent processing unit, and each pixel included in the face area has The time series data of the G signal having the representative value of the pixel value of the G component as the signal value is input to the subsequent processing unit. Among these, the R signal of the face area is input to the BPF 152R and BPF 156R in the pulse rate detection unit 15, and the G signal of the face area is input to the BPF 152G and BPF 156G in the pulse rate detection unit 15.

  Each of BPF 152R, BPF 152G, BPF 156R, and BPF 156G is a band-pass filter that passes only signal components in a predetermined frequency band and removes signal components in other frequency bands. These BPF 152R, BPF 152G, BPF 156R, and BPF 156G may be implemented by hardware, or may be implemented by software.

  The difference in the frequency band that the BPF passes will be described. The BPF 152R and the BPF 152G pass a signal component in a specific frequency band in which a noise component appears more noticeably than other frequency bands.

  Such a specific frequency band can be determined by comparing with a frequency band that can be taken by a pulse wave. An example of a frequency band that can be taken by a pulse wave is a frequency band of 0.5 Hz to 4 Hz, and a frequency band of 30 bpm to 240 bpm when converted per minute. From this, as an example of the specific frequency band, a frequency band of less than 0.5 Hz and more than 4 Hz that cannot be measured as a pulse wave can be employed. Further, the specific frequency band may partially overlap with the frequency band that can be taken by the pulse wave. For example, it is allowed to overlap with the frequency band that the pulse wave can take in the section of 0.7 Hz to 1 Hz that is difficult to be measured as a pulse wave, and the frequency band of less than 1 Hz and 4 Hz or more is adopted as the specific frequency band. You can also Further, the specific frequency band can be narrowed down to a frequency band in which noise is more noticeable with the frequency band of less than 1 Hz and 4 Hz or more as the outer edge. For example, noise appears more noticeably in a low frequency band lower than a frequency band that can take a pulse wave, rather than a high frequency band that is higher than a frequency band that the pulse wave can take. For this reason, a specific frequency band can also be narrowed down to a frequency band of less than 1 Hz. Further, since there are many differences in the sensitivity of the image sensor of each component in the vicinity of the direct current component where the spatial frequency is zero, the specific frequency band can be narrowed down to a frequency band of 0.05 Hz to less than 1 Hz. Furthermore, the specific frequency band can be narrowed down to a frequency band of 0.05 Hz or more and 0.3 Hz or less where noise such as flickering of ambient light other than human body movement, for example, blinking or shaking of the body, is likely to appear.

  Here, as an example, the following description will be given assuming that the BPF 152R and the BPF 152G pass a signal component in a frequency band of 0.05 Hz to 0.3 Hz as a specific frequency band. Here, the case where a bandpass filter is used to extract a signal component in a specific frequency band is illustrated, but a low-pass filter is used when a signal component in a frequency band below a certain frequency is extracted. You can also.

  On the other hand, the BPF 156R and the BPF 156G pass signal components in a frequency band that can be taken by a pulse wave, for example, a frequency band of 0.5 Hz to 4 Hz. Hereinafter, a frequency band that can be taken by a pulse wave may be referred to as a “pulse wave frequency band”.

  The extraction unit 153R extracts the absolute intensity value of the signal component in the specific frequency band of the R signal. For example, the extraction unit 153R extracts the absolute intensity value of the signal component in the specific frequency band by executing an absolute value calculation process of the signal component in the specific frequency band of the R component. Further, the extraction unit 153G extracts the absolute intensity value of the signal component in the specific frequency band of the G signal. For example, the extraction unit 153G extracts the absolute intensity value of the signal component in the specific frequency band by executing an absolute value calculation process of the signal component in the specific frequency band of the G component.

  The LPF 154R and the LPF 154G are low-pass filters that perform a smoothing process that responds to time changes on time-series data of absolute intensity values in a specific frequency band. The LPF 154R and the LPF 154G are the same except that the signal input to the LPF 154R is an R signal and the signal input to the LPF 154G is a G signal. By such smoothing processing, absolute intensity values R′n and G′n in a specific frequency band are obtained.

  The calculation unit 155 divides the absolute intensity value G′n of the specific frequency band of the G signal output by the LPF 154G by the absolute intensity value R′n of the specific frequency band of the R signal output by the LPF 154R. n / R'n "is executed. Thereby, a correction coefficient k for the sensitivity difference is calculated.

  The multiplier 157 multiplies the signal component in the pulse wave frequency band of the R signal output from the BPF 156R by the correction coefficient k calculated by the calculator 155.

  The calculation unit 158 subtracts the signal component of the pulse wave frequency band of the R signal multiplied by the correction coefficient k by the multiplication unit 157 from the signal component of the pulse wave frequency band of the G signal output by the BPF 156G “Gs−k *”. Rs "is executed.

  The signal thus obtained corresponds to a facial pulse wave signal, and the sampling frequency thereof corresponds to the frame frequency at which an image is captured. The pulse rate can be derived from the pulse wave signal.

  The detection unit 159 is a processing unit that detects the pulse rate from the pulse wave signal. As one aspect, the detection unit 159 calculates a differential waveform of the facial pulse wave signal by time-differentiating the waveform of the facial pulse wave signal, and a zero cross point where the sign of the differential coefficient changes from positive to negative, that is, A maximum point indicating a peak is detected. For example, the detection unit 159 determines whether or not the differential coefficient of the amplitude value detected at the previous sampling point is zero each time the amplitude value of the facial pulse wave signal is detected. At this time, if the differential coefficient of the amplitude value detected at the previous sampling point is zero, the detection unit 159 determines whether the sign of the differential coefficient of the amplitude value changes from positive to negative at the previous and subsequent sampling points. It is further determined whether or not. As a result, when the sign of the differential coefficient changes from positive to negative before and after, the detection unit 159 detects the sampling point where the differential coefficient is zero as the peak of the face pulse wave signal, and the peak appears. The sampling point time is registered in an internal memory (not shown). The pulse rate (bpm) can be calculated by converting the peak time interval thus obtained per unit time, for example, per minute. Here, the detection of the peak may not necessarily be realized by time differentiation of the waveform of the pulse wave signal, and may be detected from the waveform of the pulse wave signal of the face itself. Although the case where the pulse rate is calculated by peak detection is illustrated here, the pulse wave signal can be converted into the frequency domain by Fourier transform or the like, and the peak of the frequency spectrum can be calculated as the pulse rate.

  Returning to the description of FIG. 1, the heat stroke determination unit 16 can cause the user to develop heat stroke using the value of the WBGT calculated by the index calculation unit 12 and the pulse rate detected by the pulse rate detection unit 15. Judge whether there is sex. As one aspect, the heat stroke determination unit 16 has a value of the WBGT that exceeds a predetermined threshold, for example, 28 ° C. corresponding to the category “Severe Warning”, and the pulse rate is a predetermined threshold, for example, 100 bpm. If it exceeds, it is determined that heat stroke may have occurred in the user's body. The above threshold value is merely an example, and an arbitrary value can be set. For example, the threshold value can be optimized based on the gender, age, and past history of the user of the mobile terminal device 10.

  The notification unit 17 notifies the determination result of the heat stroke determination unit 16. For example, when the heat stroke determination unit 16 determines that the user may have developed heat stroke, the notification unit 17 notifies the alert by displaying it on a display (not shown). In addition to the alert, the notification unit 17 may, for example, send a message including at least one of WBGT or pulse rate, a message that the body is likely to have heat stroke, and a location where the temperature or humidity is lower than the current location. A message that prompts evacuation can be included in the alert. In addition, when the mobile terminal device 10 is equipped with a GPS receiver or the like, the notification unit 17 includes the location information of the mobile terminal device 10 in an alert or the condition that the nearest evacuation location from the current location, for example, indoor and air-conditioning exists It is also possible to guide the evacuation site by searching for facilities corresponding to. Although the alert by display is illustrated here, the alert can be notified by voice output.

  In addition, the notification unit 17 may notify another device that there is a high possibility that heat stroke has occurred in the user's body, for example, by performing communication using a communication unit (not shown). Other devices that are the notification destination can be preset in the notification unit 17, for example. For example, the notification unit 17 presets the mail address of the user's family, acquaintance, or the associated medical institution or the related person as the notification destination. Thereby, the notification unit 17 can send an e-mail indicating that there is a high possibility that heat stroke has occurred in the user's body to another device, and can notify the user's family, acquaintances, and medical personnel. Further, the notification unit 17 is not limited to the mail address, and a telephone number may be set in advance. The notification unit 17 is not limited to the phone numbers of family members and acquaintances, and can set an emergency call phone number (119) and a phone number of a medical facility in advance, and can notify an alert using these numbers as a notification destination.

  In addition, said functional part is realizable by making CPU (Central Processing Unit), MPU (Micro Processing Unit), etc. run a heat stroke determination program. Further, the above-described functional unit can be realized by a hard wired logic such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). The same applies to the functional units of the embodiments described below. The functional units include an index calculation unit 12, an imaging control unit 14, a pulse rate detection unit 15, a heat stroke determination unit 16, and a notification unit 17.

[Process flow]
Next, a process flow of the mobile terminal device 10 according to the first embodiment will be described. FIG. 8 is a flowchart illustrating a procedure of heat stroke determination processing according to the first embodiment. This heat stroke determination process is executed under the following start condition or cycle. For example, the heat stroke determination process can be repeatedly executed every predetermined period in the background as long as the mobile terminal device 10 is powered on. In addition, the heat stroke determination process can be started when there is a demand from the user of the mobile terminal device 10.

  As shown in FIG. 8, when the temperature and humidity measured by the sensor 11 are acquired (step S101), the index calculation unit 12 calculates the value of WBGT from the temperature and humidity measured in step S101 as the first index. (Step S102). Subsequently, the pulse rate detector 15 detects the pulse rate from the image captured by the camera 13 at a timing corresponding to the timing at which the temperature and humidity are measured by the sensor 11 (step S103).

  Thereafter, the heat stroke determination unit 16 determines whether or not the WBGT calculated in step S102 exceeds a predetermined threshold (step S104). At this time, when WBGT exceeds the threshold value (step S104 Yes), the heat stroke determination unit 16 further determines whether or not the pulse rate detected in step S103 exceeds a predetermined threshold value (step S105).

  Here, when WBGT exceeds the threshold value and the pulse rate exceeds the threshold value (step S104 Yes and step S105 Yes), the heat stroke determination unit 16 may cause the user of the mobile terminal device 10 to develop heat stroke. It is determined that there is (step S106). In this case, the notification unit 17 notifies an alarm indicating that there is a risk of developing heat stroke to a predetermined notification destination (step S107), and ends the process.

  On the other hand, when WBGT is equal to or less than the threshold value or when the pulse rate is equal to or less than the threshold value (step S104 No or step S105 No), the processing is ended as it is.

  In the example of the flowchart shown in FIG. 8, the case where the pulse rate is detected in step S103 after WBGT is calculated in step S102 is illustrated, but the order of these steps S102 and S103 may be changed. It is also possible to execute processing in parallel with each other. Further, the determinations in step S104 and step S105 only have to be performed, and the execution order of the determination is not restricted to the order shown in the figure.

[Effect of Example 1]
As described above, the portable terminal device 10 according to the present embodiment, together with the WBGT obtained from the temperature and humidity, allows the subject to contact the living body under normal environmental light such as sunlight or room light without bringing the measuring instrument into contact with the living body. The risk of developing heat stroke is determined using the pulse rate detected from the captured image. Thus, since vitals, such as a pulse rate, are used for determination of the risk of developing heat stroke in addition to an index such as WBGT obtained from temperature and humidity, a situation in which erroneous determination occurs can be suppressed. Moreover, it is not necessary to collect vitals such as the pulse rate using dedicated hardware that is not used or worn by the user in daily life, such as protective clothing or earplug sensors. Therefore, according to the mobile terminal device 10 according to the present embodiment, heat stroke can be detected without extra hardware.

  In the first embodiment, the example of determining the risk of developing heat stroke after obtaining both the first index and the pulse rate has been described. However, after obtaining both the first index and the pulse rate, it is not always necessary. It is not necessary to determine the risk of developing heat stroke. Therefore, in the second embodiment, as an example, an image is picked up when the value of WBGT exceeds a threshold, and the presence or absence of the risk of developing heat stroke is determined based on whether or not the pulse rate exceeds the threshold. explain.

[Configuration of mobile terminal device]
FIG. 9 is a block diagram illustrating a functional configuration of the mobile terminal device according to the second embodiment. The mobile terminal device 20 illustrated in FIG. 9 further includes a touch panel 21 as compared with the mobile terminal device 10 illustrated in FIG. 1, and includes an imaging control unit 22 that is partially different from the imaging control unit 14. Is different. In addition, here, what demonstrates the same function as said Example 1 attaches | subjects the code | symbol similar to the portable terminal device 10 shown in FIG. 1, and suppose that the description is abbreviate | omitted.

  The touch panel 21 is a displayable and inputable device. For example, the touch panel 21 displays information provided by an OS or an application program that operates on a processor included in the mobile terminal device 20, such as a message, an image, or a moving image. The touch panel 21 accepts an operation via a user interface displayed on the display, for example, a window provided by an OS or an application program. In this way, the position of the operation received on the display of the touch panel 21, for example, the coordinates of the screen, and the operation type, for example, tap, double tap, swipe, etc. are collected by the OS operating on the processor (not shown). The

  Here, the imaging control unit 22 executes imaging control by the camera 13 in the same manner as the imaging control unit 14 illustrated in FIG. 1, but the imaging by the camera 13 is triggered at a different timing from the imaging control unit 14 described above. The point which starts is different.

  That is, when the heat stroke determination unit 16 determines that the value of the WBGT exceeds a predetermined threshold, for example, 25 ° C. corresponding to the category “warning”, and when the operation on the touch panel 21 is detected. That is, when the mobile terminal device 20 is in use, the camera 13 is caused to start imaging. Here, a case where imaging is started when an operation on the touch panel 21 is detected is illustrated, but when an operation on a physical key such as a power button or a home key is detected, the camera 13 starts imaging. It is good as well.

  When display is being performed on the display of the touch panel 21 or various operations are performed on the touch panel 21, that is, when the mobile terminal device 20 is being used, the user touches the touch panel 21 of the mobile terminal device 20. Probably operating while browsing. Therefore, the in-camera provided on the same side surface as the touch panel 21 can be considered that the face of the user whose line of sight is directed to the touch panel 21 is within the imaging range. For this reason, it is possible to suppress wasteful imaging of an image in which the face of the user of the mobile terminal device 20 is not reflected by focusing on the touch panel 21 and causing the camera 13 to perform imaging.

  For example, the imaging control unit 22 determines the usage state as follows, for example. The imaging control unit 22 detects the presence or absence of a touch operation on the touch panel 21. The imaging control unit 22 determines that the mobile terminal device 20 is in use when the touch interval on the touch panel 21 is within a certain interval. At this time, the touch panel passes information indicating that finger contact has been detected to the heat stroke determination program via the device driver. The heat stroke determination program can receive input information related to touch from the lower level through, for example, an API (Application Programming Interface).

  For example, an Android (registered trademark) OS that is an OS for a mobile terminal is as follows. That is, an event called “on Touch Event” is generated by touching the touch panel 21. As a result, information such as the touch coordinates and the type of touch action (pressed, released, etc.) is passed to the heat stroke determination program as arguments. Therefore, by using this information, the heat stroke determination program can determine that the mobile terminal device 20 is being used. For example, the imaging control unit 22 can determine that a predetermined period, for example, 3 seconds, is being used from the time when the touch operation is detected, or when a plurality of touch operations or a specific type of touch operation is detected. Alternatively, it may be determined that the mobile terminal device 20 is in use. In this way, it is possible to determine whether or not the mobile terminal device 20 is in use by detecting an operation on the touch panel 21.

  As described above, in order to cause the camera 13 to start imaging, the condition that the value of WBGT exceeds the threshold and that an operation on the touch panel 21 is detected is to reduce the startup time of the camera 13. is there. That is, imaging by the camera 13 is performed only in an environment where the risk of developing heat stroke can occur due to the above-described condition setting and there is a high possibility that the user's face is contained in the imaging range of the camera 13 Can be made. Therefore, the power consumption of the battery mounted on the mobile terminal device 20 can be suppressed.

  When the heat stroke determination unit 16 determines that the first index calculated by the index calculation unit 12 exceeds the threshold, the pulse rate detected by the pulse rate detection unit 15 exceeds a predetermined threshold, for example, 100 bpm Furthermore, it is determined that the user of the mobile terminal device 20 may have developed heat stroke.

[Process flow]
Next, a process flow of the mobile terminal device 20 according to the second embodiment will be described. FIG. 10 is a flowchart illustrating a procedure of heat stroke determination processing according to the second embodiment. The heat stroke determination process shown in FIG. 10 can also be executed under the same start condition or cycle as in the flowchart shown in FIG.

  As shown in FIG. 10, when the temperature and humidity collected by the sensor 11 are acquired (step S201), the index calculation unit 12 calculates WBGT from the temperature and humidity acquired in step S201 (step S202). . Subsequently, the heat stroke determination unit 16 determines whether or not the value of WBGT calculated in step S202 exceeds a predetermined threshold (step S203). In addition, when the value of WBGT is below a threshold value (step S203 No), since the risk that the user develops heat stroke is low, the subsequent processing is omitted and the processing is ended as it is.

  At this time, when the value of WBGT exceeds the threshold (Yes at Step S203), the imaging control unit 22 detects the usage state of the mobile terminal device 20 (Step S204). And when the portable terminal device 20 is in use, ie, when operation with respect to the portable terminal device 20 is detected (step S205 Yes), the imaging control part 22 makes the camera 13 start imaging. In addition, the pulse rate detector 15 detects the pulse rate from the image captured by the camera 13 (step S206). If an operation on the mobile terminal device 20 is not detected (No in step S205), the process returns to step S204, and the subsequent processing is waited until an operation on the mobile terminal device 20 is detected.

  The heat stroke determination unit 16 determines whether or not the pulse rate value detected in step S206 exceeds a predetermined threshold (step S207). When the pulse rate value is equal to or less than the threshold value (No in step S207), the risk of the user developing heat stroke is low, so the subsequent processing is omitted and the processing ends.

  Here, when the value of the pulse rate exceeds the threshold value (step S207 Yes), the heat stroke determination unit 16 determines that there is a possibility that the user has developed heat stroke (step S208). In this case, the notification unit 17 notifies an alarm indicating that there is a risk of developing heat stroke to a predetermined notification destination (step S209), and ends the process.

  In the flowchart shown in FIG. 10, the case where the value of the pulse rate exceeds the threshold value is exemplified by narrowing down when the value of the WBGT exceeds the threshold value, but the value of the pulse rate exceeds the threshold value. It may be determined whether or not the value of WBGT exceeds a threshold value.

[Effect of Example 2]
As described above, according to the mobile terminal device 20 according to the present embodiment, heat stroke can be detected without extra hardware as in the first embodiment.

  Furthermore, the mobile terminal device 20 according to the present embodiment causes the camera 13 to start imaging only when the WBGT exceeds the threshold and when an operation on the touch panel 21 is detected. Therefore, in the mobile terminal device 20 according to the present embodiment, imaging is performed by the camera 13 in a scene where it can be estimated from the climate that there is no risk of heat stroke or when the user's face is not within the imaging range of the camera 13. Can be suppressed. Therefore, according to the mobile terminal device 10 according to the present embodiment, the operation time of the camera 13 can be suppressed, and as a result, battery consumption can be suppressed.

  Now, in the above-mentioned Example 1 and Example 2, the case of determining the risk of developing heat stroke was illustrated, but in addition to this, the level of heat stroke that the user is developing can be further determined. . Therefore, in the present embodiment, an example will be described in which the blood flow rate of the user is obtained from the image captured by the camera 13 and the heat stroke level is determined from the blood flow rate.

[Configuration of mobile terminal device]
FIG. 11 is a block diagram illustrating a functional configuration of the mobile terminal device according to the third embodiment. The mobile terminal device 30 illustrated in FIG. 11 is different from the mobile terminal device 20 illustrated in FIG. 9 in that the mobile terminal device 30 further includes a blood flow rate calculation unit 31 and a level determination unit 32. Here, the same reference numerals are given to those that exhibit the same functions as those in the first and second embodiments, and the description thereof will be omitted.

  The blood flow rate calculation unit 31 is a processing unit that calculates a blood flow rate from an image captured by the camera 13. As one aspect, the blood flow rate calculation unit 31 uses the fact that there is a correlation between the amplitude of the pulse wave signal and the blood flow rate, and the amount of change in the amplitude value of the pulse wave signal detected by the pulse rate detection unit 15 Based on the above, blood flow is calculated.

  Here, heat stroke and changes in blood flow will be described. As an example, the symptoms of heat stroke are divided into a plurality of levels of “mild”, “moderate” and “severe”. Of these, “mild” refers to a condition called mild sunstroke. In this case, symptoms such as dizziness on standing, convulsions accompanied by pain in the extremities and abdominal muscles, decreased blood pressure, paleness in front of the eyes, fluttering, increased respiratory rate, and fainting may occur. “Moderate” refers to a condition called sunstroke, heat syncope or heat fatigue. In this case, although the symptoms of heat stroke are relatively mild compared to severe, the complexion of the user becomes blue, that is, white due to blood reduction due to blood pressure reduction due to skin vasodilation and dehydration due to sweating. Further, “severe” refers to a condition called severe sunstroke or heatstroke. In this case, the symptoms of heat stroke are heavy, and contrary to mild or moderate symptoms, the body temperature control function cannot catch up and the body temperature rises, and the user's complexion becomes red.

  Thus, when the symptom is “moderate”, the blood flow rate decreases, and when the symptom is “severe”, the blood flow rate increases. From this, if it is possible to detect whether the blood flow volume decreases or increases, when there is a risk of developing heat stroke, the level of the symptom can be further detected.

  However, the amplitude of the pulse wave signal changes in proportion to the intensity of the ambient light. Therefore, the representative value of the G component of each pixel included in the image captured by the camera 13, that is, the amplitude value of the G signal is time-averaged to obtain the intensity of the ambient light, and the amplitude of the pulse wave signal is calculated as The blood flow is calculated by dividing by the time average of the amplitude value.

  FIG. 12 is a block diagram showing a functional configuration of the blood flow rate calculation unit 31. As illustrated in FIG. 12, the blood flow rate calculation unit 31 includes an amplitude acquisition unit 311, a time average calculation unit 312, a division unit 313, and a change amount calculation unit 314. In addition, since the pulse rate detection part 15 in a figure is the same as that of what was shown in FIG. 7, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

  Among these, the amplitude acquisition unit 311 is a processing unit that acquires the amplitude value of the pulse wave signal detected by the pulse rate detection unit 15. As an aspect, the amplitude acquisition unit 311 acquires the amplitude value of the pulse wave signal of the face from which noise such as ambient light and body movement has been removed by the calculation by the calculation unit 148.

  The time average calculation unit 312 is a processing unit that calculates the time average of the G signal. As one aspect, the time average calculation unit 312 acquires the representative value of the G component of each pixel included in the face area calculated by the representative value calculation unit 141G, that is, the amplitude value of the G signal over a predetermined time. Then, the time average calculation unit 312 averages each of the amplitude values of the G signal acquired over a predetermined time.

  The division unit 313 is a processing unit that divides the amplitude value of the pulse wave signal detected by the pulse rate detection unit 15 by the time average value of the G signal calculated by the time average calculation unit 312. It can be said that the division value of the amplitude extracted in this way includes a luminance change as a main component due to a change in blood flow.

  The change amount calculation unit 314 is a processing unit that calculates the change amount of the division value of the amplitude divided by the division unit 313. As one aspect, the change amount calculation unit 314 monitors the change in the division value of the amplitude output by the division unit 313 over a predetermined time. As an example of such monitoring time, one period of a pulse wave, that is, a time including at least one beat can be employed. For example, if the minimum value of the pulse rate that a person can take is 30 bpm, the waveform for one beat can be monitored if the amplitude division value is continuously monitored for 3 seconds. Then, the change amount calculation unit 314 calculates the difference between the maximum value and the minimum value among the divided values of the amplitude collected over the monitoring time. The difference between the maximum value and the minimum value of the division value of the amplitude thus calculated is proportional to the fact that the larger the difference is, the larger the blood flow is, and the smaller the difference is, the smaller the blood flow is. It can be used as an indicator.

  Returning to the description of FIG. 11, the level determination unit 32 is a processing unit that determines a symptom level of heat stroke from a change in the blood flow calculated by the blood flow calculation unit 31. As one aspect, when the heat stroke determination unit 16 determines that there is a risk of developing heat stroke, the level determination unit 32 determines the difference between the maximum and minimum values of the amplitude division value and the decrease in blood flow. The moderate threshold used to do and the severe threshold used to determine an increase in blood flow are compared. Accordingly, the level determination unit 32 determines whether the symptom level of heat stroke is mild, moderate, or severe.

  Here, as an example of a threshold value to be compared with the above blood flow rate, a value obtained from the difference between the maximum value and the minimum value of the amplitude division values collected in a steady state can be adopted as the threshold value. For example, the level determination unit 32 collects the amplitude division value when the user of the mobile terminal device 30 is in a steady state, for example, when the pulse rate is 60 bpm or more and 80 bpm. After that, the level determination unit 32 calculates the threshold for the moderate condition and the threshold for the serious condition (the threshold for the moderate condition <the maximum value and the minimum value) from the difference between the maximum value and the minimum value of the amplitude division values collected in the steady state. Difference <threshold for severeness) can be derived in advance. Then, the level determination unit 32 determines whether or not the difference between the maximum value and the minimum value of the amplitude division value output by the blood flow rate calculation unit 31, that is, whether the blood flow rate is equal to or less than the moderate threshold value. At this time, the level determination unit 32 determines that the level of the symptom of heat stroke is “moderate” when the blood flow is equal to or less than the moderate threshold. On the other hand, when the blood flow volume exceeds the moderate threshold, the level determination unit 32 further determines whether or not the blood flow is greater than or equal to the severe threshold. And the level determination part 32 determines with the level of the symptom of heat stroke being "serious", when the blood flow rate is more than the threshold value for seriousness. When the blood flow is larger than the moderate threshold and smaller than the severe threshold, it is determined that the symptom level of heat stroke is “mild”.

  In addition, although the case where the threshold value for moderateness and the threshold value for seriousness are calculated | required from the difference of the maximum value and minimum value of the division value of the amplitude collected in the steady state was illustrated here, other threshold values can also be used. . For example, the level determination unit 32 stores the blood flow volume calculated by the blood flow rate calculation unit 31 after the heat stroke determination unit 16 determines that there is a risk of developing heat stroke in a predetermined storage unit. Then, the level determination unit 32 determines that the disease is moderate when the decrease in blood flow is equal to or greater than a predetermined value during a predetermined period after the risk of developing heat stroke is detected, and is determined as moderate. If the amount of increase in blood flow is greater than or equal to a predetermined value during a predetermined period of time, it may be determined as severe. In addition, what is necessary is just to determine with a mild case, when the reduction amount of a blood flow rate is less than a predetermined value during the predetermined period after the onset risk of heat stroke is detected.

  Thus, the level of the symptom determined by the level determination unit 32 can be included in the content of the alert notified by the notification unit 17. Thereby, it is possible to appropriately cope with the heat stroke symptom level. For example, in the case of mild cases, it is dealt with by evacuation by one's own power, in the case of moderate cases, it is dealt with with the assistance of users concerned, such as family members, family doctors, nurses, etc. It can be dealt with by emergency services such as the Fire Department.

  At this time, the notification destination of the alert can be changed according to the level of the symptom level. For example, the notification unit 17 provides a table for associating the heat stroke level with the notification destination. When the level determination unit 32 determines the heat stroke level, the notification unit 17 refers to the table and corresponds to the level. What is necessary is just to acquire a notification destination. For example, if it is mild, the alert notification destination is the user of the mobile terminal device 30, and if it is moderate, medical personnel such as the user's home doctor are further included as the notification destination. In this case, the nearest fire department can be further included as a notification destination from the position information of the mobile terminal device 30.

  In this manner, by changing the notification destination according to the heat stroke level determined by the level determination unit 32, for example, when the symptom is mild, the user who is notified of the alert moves from the current location, for example. can do. On the other hand, when the symptom is moderate or severe, even if the user himself / herself cannot move, the family, medical personnel, emergency personnel, etc. can help the user.

[Process flow]
Subsequently, a process flow of the mobile terminal device 30 according to the third embodiment will be described. FIG. 13 is a flowchart illustrating a procedure of heat stroke determination processing according to the third embodiment. The heat stroke determination process shown in FIG. 13 can also be executed under the same start condition or cycle as in the flowchart shown in FIG.

  As shown in FIG. 13, when the temperature and humidity detected by the sensor 11 are acquired (step S301), the index calculation unit 12 calculates WBGT from the temperature and humidity acquired in step S301 (step S302). . Subsequently, the heat stroke determination unit 16 determines whether or not the value of WBGT calculated in step S302 exceeds a predetermined threshold (step S303). In addition, when the value of WBGT is below a threshold value (step S303 No), since the risk that the user of the portable terminal device 30 develops heat stroke is low, the subsequent processing is omitted and the processing is ended as it is. .

  At this time, if the value of WBGT exceeds the threshold (Yes at Step S303), the imaging control unit 22 detects the usage state of the mobile terminal device 30 (Step S304). When the mobile terminal device 30 is being used, that is, when an operation on the mobile terminal device 30 is detected (Yes in step S305), the imaging control unit 22 causes the camera 13 to start imaging. In addition, the pulse rate detection unit 15 detects the pulse rate from the image captured by the camera 13 (step S306). If an operation on the mobile terminal device 30 is not detected (No in step S305), the process returns to step S304 and waits for subsequent processing until an operation on the mobile terminal device 30 is detected.

  Then, the heat stroke determination unit 16 determines whether or not the pulse rate value detected in step S306 exceeds a predetermined threshold (step S307). If the pulse rate is less than or equal to the threshold value (No in step S307), the risk of the user developing heat stroke is low, so the subsequent processing is omitted and the processing ends.

  Here, when the value of the pulse rate exceeds the threshold value (step S307 Yes), the heat stroke determination unit 16 determines that the user may have developed heat stroke (step S308). In this case, the blood flow rate calculation unit 31 calculates the blood flow rate using the amplitude value of the pulse wave signal detected by the pulse rate detection unit 15 (step S309). In addition, the level determination unit 32 determines the level of the symptom of heat stroke from the change in the blood flow calculated in step S309 (step S310). Thereafter, the notification unit 17 notifies the alarm that there is a risk of developing heat stroke including the level of onset determined in step S310 to a predetermined notification destination (step S311), and ends the process.

  In the flowchart shown in FIG. 13, the case where the value of the pulse rate exceeds the threshold is illustrated by squeezing when the value of the WBGT exceeds the threshold, but the value of the pulse rate exceeds the threshold. It may be determined whether or not the value of WBGT exceeds a threshold value.

[Effect of Example 3]
As described above, according to the mobile terminal device 30 according to the present embodiment, heat stroke can be detected without extra hardware, as in the first and second embodiments.

  Furthermore, the mobile terminal device 30 according to the present embodiment determines the level of the symptom of heat stroke from the change in blood flow calculated using the amplitude value of the pulse wave signal, and alarms that there is a risk of developing heat stroke. Informs a predetermined notification destination including the onset level. As a result, the notification destination notified of the alarm can appropriately deal with the heat stroke symptom level. For example, in the case of mild cases, it is dealt with by evacuation by one's own power, in the case of moderate cases, it is dealt with with the assistance of users concerned, such as family members, family doctors, nurses, etc. It can be dealt with by emergency services such as the Fire Department.

  In the first to third embodiments, the case where the threshold value to be compared with the first index and the threshold value to be compared with the pulse rate are fixedly used is exemplified. However, such a threshold value may be dynamically changed. Therefore, in the present embodiment, an example will be described in which various threshold values are changed depending on whether or not the user of the mobile terminal device 40 is accustomed to heat.

[Configuration of mobile terminal device]
FIG. 14 is a block diagram illustrating a functional configuration of the mobile terminal device according to the fourth embodiment. The mobile terminal device 40 shown in FIG. 14 is different from the mobile terminal device shown in FIG. 9 in that the mobile terminal device 40 further includes a storage unit 32, a storage unit 33, and a heat acclimatization determination unit 34. Here, the same reference numerals are given to those that exhibit the same functions as those in the first and second embodiments, and the description thereof will be omitted.

  Here, the heat stroke determination unit 31 illustrated in FIG. 14 uses two types of threshold values, WBGT1 and WBGT2, as threshold values to be compared with the WBGT calculated by the index calculation unit 12. Among these, WBGT1 is a threshold value used for determining whether or not to detect the pulse rate. For example, when the value of WBGT exceeds WBGT1, the pulse rate is detected from the image captured by the camera 13. The pulse rate is detected by the unit 15. WBGT2 is a threshold value used to determine the risk of developing heat stroke. When the value of WBGT exceeds WBGT2, it is determined whether or not the pulse rate exceeds the threshold value. These WBGT1 and WBGT2 have a relationship of WBGT1 <WBGT2. For this reason, just because the pulse rate is detected does not necessarily determine the risk of developing heat stroke. The reason for detecting the pulse rate for the purpose other than the purpose of setting the two-stage threshold and determining the risk of developing heat stroke is to obtain a sample of the pulse rate in a hot environment.

  The storage unit 32 is a processing unit that stores the pulse rate detected by the pulse rate detection unit 15 in the storage unit 33. As one aspect, the storage unit 32 stores only the pulse rate detected after the WBGT is determined to exceed WBGT1 by the heat stroke determination unit 31 among the pulse rates detected by the pulse rate detection unit 15. Save to 33. The reason for selecting the pulse rate to be stored in the storage unit 33 in this manner is to save the pulse rate in the storage unit 33 by focusing on the pulse rate detected in the hot environment.

  The storage unit 33 is a storage device that stores various types of information, for example, the pulse rate. As an aspect, the storage unit 32 stores the pulse rate detected when WBGT exceeds WBGT1 in the storage unit 33. For example, the storage unit 33 stores, together with the pulse rate, items such as the value of WBGT when the pulse rate is detected and the time when the pulse rate is detected. The pulse rate does not necessarily have to be stored on the memory of the mobile terminal device 40, but may be stored in a computer accessible by the mobile terminal device 40, such as a server device.

  The heat acclimatization determination unit 34 is a processing unit that determines whether or not acclimatization to heat is possible depending on whether or not the statistical value of the pulse rate stored in the storage unit 33 is less than a predetermined threshold.

  Here, heat acclimatization means that the body adapts to heat. In general, when a person lives in a hot environment, for example, a hot and humid environment for a certain period of time such as several days to one or two weeks, the person becomes accustomed to the environment and the sympathetic nerve is activated and the heart rate decreases. This phenomenon is called heat acclimation.

  In this way, between those who are acclimatized to heat and those who are not acclimatized to heat, even in an environment of the same temperature and humidity, they are acclimatized to heat more than those who are not acclimatized to heat. Those who are more resistant to heat stroke. If the risk of heat stroke is determined using the same threshold for both of these, there is a risk of erroneous determination. Therefore, the value of WBGT2 to be compared with WBGT is changed depending on whether or not the user of the mobile terminal device 40 has acclimatized to heat.

  As one aspect, the heat acclimatization determination unit 34 determines whether or not the user of the mobile terminal device 40 has acclimatized to heat using the pulse rate stored in the storage unit 33 at the opportunity illustrated below. To do. For example, the heat acclimatization determination unit 34 may determine whether or not heat acclimatization is performed on a daily cycle, for example, at 24:00, or may determine whether heat acclimatization is possible or not in response to a demand from a user. it can.

  More specifically, the heat acclimatization determination unit 34 reads out the pulse rate stored in the storage unit 33 when the time stamp of the mobile terminal device 40 is on time. At this time, the heat acclimatization determination unit 34 performs predetermined statistical processing on the pulse rate read from the storage unit 33. For example, the average value of the daily heart rate is calculated by calculating the average value of the pulse rate read from the storage unit 33. In addition, although the case where the average value is calculated is illustrated here, the mode value and the median value may be extracted, and when averaging is performed, an arithmetic average is started, a weighted average, a moving average, etc. Averaging may be performed.

  Thereafter, the heat acclimatization determination unit 34 determines whether or not the average value of the daily heart rate is less than the threshold value HRth2. The HRth2 is a threshold value for determining whether or not a person is acclimatized to a hot environment. For example, the HRth2 may be set from a pulse rate at rest measured by a user in an environment of a suitable temperature that is not a hot environment. it can.

  At this time, when the average value of the daily heart rate is less than the threshold value HRth2, it can be estimated that acclimatization to the heat of the user of the mobile terminal device 40 has been completed. In this case, the heat acclimatization determination unit 34 sets WBGT21, for example, 32 ° C., as the value of WBGT2 used by the heat stroke determination unit 31. On the other hand, when the average value of the daily heart rate is equal to or greater than the threshold value HRth2, it can be estimated that acclimatization to the heat of the user of the mobile terminal device 40 has not yet been completed. In this case, the heat acclimatization determination unit 34 sets WBGT22, for example, 30 ° C. as the value of WBGT2 used by the heat stroke determination unit 31.

  The heat acclimatization determination unit 34 uses the heat stroke determination unit 31 when the pulse rate is not continuously stored in the storage unit 33 for a predetermined number of days, for example, one week, two weeks, or 10 days. WBGT22, for example, 30 ° C. is set as the threshold value of WBGT2. This is because, even if the user of the mobile terminal device 40 has been acclimatized, if the user is not in the hot environment for a certain period of time after that, the user returns to a state in which the user has not acclimatized to the hot environment. It is.

  As described above, when acclimatization to heat is completed, a higher threshold is set than when acclimatization to heat is not completed. As a result, people who have been acclimatized to heat have been determined to have heat stroke even though they have not been heat stroked, or those who have not yet been acclimatized to heat have heatstroke. The situation where it is determined that there is no risk of developing heat stroke can be suppressed. As a result, the determination accuracy of heat stroke can be increased. Although the case where it is determined here whether or not the average value of the daily heart rate is less than the threshold value HRth2 has been described, the determination method of acclimatization or unacclimation is not limited to this. For example, WBGT21 is set as the value of WBGT2 when the reduction rate of the average value of the daily heart rate exceeds a predetermined threshold, and when the reduction rate of the average value of the daily heart rate is equal to or less than the threshold, the value of WBGT2 WBGT21 can also be set as a value.

[Process flow]
Subsequently, a process flow of the mobile terminal device 40 according to the fourth embodiment will be described. Here, after (1) threshold setting processing executed by the mobile terminal device 40 is described, (2) heat stroke determination processing is described.

(1) Threshold Setting Process FIG. 15 is a flowchart illustrating the procedure of the threshold setting process according to the fourth embodiment. This threshold value setting process is executed under the following start condition or cycle. For example, the threshold value setting process can be started on a daily cycle, for example, at 24:00, or can be started in response to a demand from a user of the mobile terminal device 40.

  As illustrated in FIG. 15, the heat acclimatization determination unit 34 reads out the pulse rate stored in the storage unit 33 (step S <b> 401). At this time, if the pulse rate data is present in the storage unit 33 (Yes in step S402), the heat acclimatization determination unit 34 calculates the average value of the pulse rate read in step S401 to calculate the daily rate. An average value of the heart rate is calculated (step S403).

  Thereafter, the heat acclimatization determination unit 34 determines whether or not the average value of the daily heart rate is less than the threshold value HRth2 (step S404). At this time, when the average value of the daily heart rate is less than the threshold value HRth2 (step S404 Yes), it can be estimated that the acclimatization to the heat of the user of the mobile terminal device 40 has been completed. In this case, the heat acclimatization determination unit 34 sets the WBGT 21 for acclimatization as the value of WBGT2 used by the heat stroke determination unit 31 (step S405), and ends the process.

  On the other hand, when the average value of the daily heart rate is equal to or greater than the threshold value HRth2 (No in step S404), it can be estimated that acclimatization to the heat of the user of the mobile terminal device 40 has not yet been completed. In this case, the heat acclimatization determination unit 34 sets the WBGT 22 for unacclimation as the value of WBGT2 used by the heat stroke determination unit 31 (step S406).

  When the pulse rate data does not exist in the storage unit 33 (No in step S402), the heat acclimatization determination unit 34 determines that the period during which the pulse rate is not stored in the storage unit 33 is a predetermined number of days N, for example, It is determined whether or not one week, two weeks or 10 days have been reached (step S407).

  And when the period when the pulse rate is not preserve | saved at the memory | storage part 33 has reached the predetermined number of days N (step S407 Yes), the heat acclimatization determination part 34 is used as the threshold value of WBGT2 which the heat stroke determination part 31 uses. The WBGT 22 for unacclimation is set (step S406), and the process is terminated. In addition, when the period when the pulse rate is not stored in the storage unit 33 has not reached the predetermined number of days N (No in step S407), the previous threshold value setting is maintained without executing the threshold value setting this time, The process is terminated as it is.

(2) Heatstroke Determination Processing FIG. 16 is a flowchart illustrating a procedure of heatstroke determination processing according to the fourth embodiment. Also in the heat stroke determination process shown in FIG. 16, it can be executed under the same start condition or cycle as in the flowchart shown in FIG.

  As shown in FIG. 16, when the temperature and humidity collected by the sensor 11 are acquired (step S501), the index calculation unit 12 calculates WBGT from the temperature and humidity acquired in step S501 (step S502). . Subsequently, the heat stroke determination unit 31 determines whether or not the value of WBGT calculated in step S502 exceeds WBGT1 (step S503). When the value of WBGT is equal to or less than WBGT1 (No in step S503), the risk that the user has developed heat stroke may be ignored, and the pulse rate may not be sampled because there is no heat environment. The subsequent processing is omitted and the processing is terminated as it is.

  At this time, when the value of WBGT exceeds WBGT1 (step S503 Yes), the imaging control unit 22 detects the usage state of the mobile terminal device 20 (step S504). And when the portable terminal device 40 is in use, ie, when operation with respect to the portable terminal device 40 is detected (step S505 Yes), the imaging control part 22 makes the camera 13 start imaging. In addition, the pulse rate detector 15 detects the pulse rate from the image captured by the camera 13 (step S506). And the preservation | save part 32 preserve | saves the pulse rate detected by step S506 in the memory | storage part 33 (step S507). If an operation on the mobile terminal device 40 is not detected (No in step S505), the process returns to step S504 and waits for subsequent processing until an operation on the mobile terminal device 40 is detected.

  Here, the heat stroke determination unit 31 determines whether or not the WBGT calculated in step S502 exceeds WBGT2 (step S508). At this time, the heat stroke determination unit 31 uses the threshold value set by the threshold setting process shown in FIG. 15 among the WBGT 21 and the WBGT 22 for the determination in step S508.

  And when WBGT exceeds WBGT2 (step S508 Yes), the heat stroke determination part 31 further determines whether the value of the pulse rate detected by step S506 exceeds a predetermined threshold value (step S509). If the pulse rate is less than or equal to the threshold value (No in step S509), the risk of the user developing heat stroke is low, so the subsequent processing is omitted and the processing ends.

  On the other hand, when the value of the pulse rate exceeds the threshold value (step S509 Yes), the heat stroke determination unit 31 determines that there is a possibility that the user has developed heat stroke (step S510). In this case, the notification unit 17 notifies an alarm indicating that there is a risk of developing heat stroke to a predetermined notification destination (step S511), and ends the process.

  In the flowchart shown in FIG. 16, the case where it is determined whether the pulse rate value exceeds the threshold value when the WBGT value exceeds the threshold value is exemplified, but the pulse rate value exceeds the threshold value. It may be determined whether or not the value of WBGT exceeds a threshold value.

[Effect of Example 4]
As described above, the mobile terminal device 40 according to the present embodiment changes the value of WBGT2 to be compared with WBGT depending on whether or not the user of the mobile terminal device 40 has acclimatized to heat. For this reason, people who have been acclimatized to heat have been determined to have heat stroke even though they have not been heat stroked, or those who have not yet acclimatized to heat have heat stroke. The situation where it is determined that there is no risk of developing heat stroke can be suppressed. Therefore, according to the mobile terminal device 40 according to the present embodiment, it is possible to improve the determination accuracy of heat stroke.

  Although the embodiments related to the disclosed apparatus have been described above, the present invention may be implemented in various different forms other than the above-described embodiments. Therefore, another embodiment included in the present invention will be described below.

[input signal]
In the first to fourth embodiments described above, the case where two types of R signal and G signal are used as the input signal has been illustrated. However, any type of signal and any number of signals having different optical wavelength components may be used. A number of signals can be input signals. For example, two signals of any combination among signals having different optical wavelength components such as R, G, B, IR, and NIR can be used, or three or more signals can be used.

[Combination of each embodiment]
In the above-described Example 3 and Example 4, the case where the threshold value setting based on the symptom level determination and heat acclimatization is individually performed is illustrated, but these examples can also be implemented in combination.

[Other example 1]
In the above-described first to fifth embodiments, the case where the mobile terminal device 10 executes the above-described heat stroke determination process in a stand-alone manner is illustrated, but it can also be implemented as a client-server system. For example, at least one or a combination of the mobile terminal devices 10 to 40 may be implemented as a Web server that provides a heat stroke determination service, or may be implemented as a cloud that provides a heat stroke determination service through outsourcing. It doesn't matter. In this way, when at least one or a combination of the mobile terminal devices 10 to 40 operates as a server device, a mobile terminal device such as a smartphone or a mobile phone or an information processing device such as a personal computer is accommodated as a client terminal. can do. When temperature / humidity or an image is acquired from these client terminals via a network, heat stroke determination processing is executed, and an alert can be notified to an arbitrary notification destination.

[Other implementation example 2]
In the first to fourth embodiments, the portable terminal device is illustrated as an example of the mounting form, but the present invention is not limited to this. For example, a semiconductor chip on which a processor capable of executing a heat stroke determination program that realizes the function of each unit other than hardware such as the sensor 11, the camera 13, and the touch panel 21 may be mounted as a heat stroke determination device. Absent.

[Distribution and integration]
In addition, each component of each illustrated apparatus does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution / integration of each device is not limited to that shown in the figure, and all or a part thereof may be functionally or physically distributed or arbitrarily distributed in arbitrary units according to various loads or usage conditions. Can be integrated and configured. For example, the index calculation unit 12, the pulse rate detection unit 15, the heat stroke determination unit 16, or the notification unit 17 may be connected as an external device of the heat stroke determination device 10 via a network. In addition, the function of the heat stroke determination device 10 described above can be obtained by having the index calculation unit 12, the pulse rate detection unit 15, the heat stroke determination unit 16 or the notification unit 17 connected to each other and connected in a network. May be realized.

[Heat stroke determination program]
The various processes described in the above embodiments can be realized by executing a prepared program on a computer such as a personal computer or a workstation. In the following, an example of a computer that executes a heat stroke determination program having the same function as that of the above-described embodiment will be described with reference to FIG.

  FIG. 17 is a schematic diagram illustrating an example of a computer that executes a heat stroke determination program according to the first and second embodiments. As shown in FIG. 17, the computer 1000 includes an operation unit 1100a, a speaker 1100b, a camera 1100c, a display 1200, and a communication unit 1300. Further, the computer 1000 includes a CPU 1500, a ROM 1600, an HDD 1700, and a RAM 1800. These units 1100 to 1800 are connected via a bus 1400.

  As shown in FIG. 17, the HDD 1700 stores in advance a heat stroke determination program 1700 a that exhibits the same function as each functional unit shown in the first to fifth embodiments. The heat stroke determination program 1700a may be integrated or separated as appropriate, as with each component of each functional unit shown in FIG. 1, FIG. 9, FIG. 11, or FIG. In other words, all the data stored in the HDD 1700 need not always be stored in the HDD 1700, and only the data necessary for processing may be stored in the HDD 1700.

  Then, the CPU 1500 reads the heat stroke determination program 1700a from the HDD 1700 and develops it in the RAM 1800. Accordingly, as shown in FIG. 17, the heat stroke determination program 1700a functions as a heat stroke determination process 1800a. The heat stroke determination process 1800a expands various data read from the HDD 1700 in an area allocated to itself on the RAM 1800 as appropriate, and executes various processes based on the expanded data. The heat stroke determination process 1800a is performed in the processing executed by each functional unit shown in FIG. 1, FIG. 9, FIG. 11 or FIG. 14, such as FIG. 8, FIG. 10, FIG. Includes the processing shown. In addition, each processing unit virtually realized on the CPU 1500 does not always require that all processing units operate on the CPU 1500, and only a processing unit necessary for processing may be virtually realized.

  Note that the heat stroke determination program 1700a is not necessarily stored in the HDD 1700 or the ROM 1600 from the beginning. For example, each program is stored in a “portable physical medium” such as a flexible disk inserted into the computer 1000, so-called FD, CD-ROM, DVD disk, magneto-optical disk, or IC card. Then, the computer 1000 may acquire and execute each program from these portable physical media. Each program may be stored in another computer or server device connected to the computer 1000 via a public line, the Internet, a LAN, a WAN, or the like. In that case, the computer 1000 may acquire and execute each program from another computer or server device.

DESCRIPTION OF SYMBOLS 10 Portable terminal device 11 Sensor 12 Index | exponent calculation part 13 Camera 14 Imaging control part 15 Pulse rate detection part 150 Area | region extraction part 151R, 151G Representative value calculation part 152R, 152G, 156R, 156G BPF
153R, 153G extraction unit 154R, 154G LPF
155 Calculation unit 157 Multiplication unit 158 Calculation unit 159 Detection unit 16 Heat stroke determination unit 17 Notification unit

Claims (9)

An index calculation unit that calculates a first index from at least one of temperature and humidity collected by the sensor;
A pulse rate detector that detects the pulse rate from an image captured by the camera;
Using the first index calculated by the index calculation unit and the pulse rate detected by the pulse rate detection unit, a heat stroke determination unit that determines whether there is a possibility of developing heat stroke,
A heat stroke determination apparatus, comprising: a notification unit that notifies a determination result by the heat stroke determination unit.   The heat stroke determination apparatus according to claim 1, further comprising an imaging control unit that starts imaging by the camera when an operation on the heat stroke determination apparatus is detected.   The heat stroke determination apparatus according to claim 1, further comprising an imaging control unit that starts imaging by the camera when the first index calculated by the index calculation unit exceeds a predetermined threshold. .   The heat stroke determination unit, when the first index calculated by the index calculation unit exceeds a predetermined threshold, and the pulse rate detected by the pulse rate detection unit exceeds a predetermined threshold, heat stroke The heat stroke determination apparatus according to claim 1, wherein the heat stroke determination apparatus determines that there is a possibility of developing the disease. A blood flow calculation unit for calculating a blood flow from the image;
A level determination unit that determines a level of heat stroke from a change in blood flow calculated by the blood flow calculation unit;
The heat stroke determination apparatus according to claim 1, wherein the notification unit further notifies the level determined by the level determination unit. A storage unit for storing the pulse rate detected by the pulse rate detection unit in a predetermined storage unit when the first index calculated by the index calculation unit exceeds the threshold;
A heat acclimatization determination unit that determines whether or not acclimatization to heat is possible depending on whether or not the statistical value of the pulse rate stored in the storage unit is less than a predetermined threshold;
And a threshold value changing unit that changes a threshold value to be compared with the first index or a threshold value to be compared with the pulse rate when it is determined by the heat acclimation determining unit to be acclimatized to heat. The heatstroke determination device according to any one of claims 1 to 5. A sensor for acquiring information on at least one of temperature and humidity;
A camera for capturing images;
An index calculating unit that calculates a first index from information collected by the sensor;
A pulse rate detector for detecting a pulse rate from an image captured by the camera;
A heat stroke determination unit that determines whether or not there is a possibility of developing heat stroke, using the first index calculated by the index calculation unit and the pulse rate detected by the pulse rate detection unit,
A portable terminal device comprising: a notification unit that notifies a determination result by the heat stroke determination unit. Computer
Calculating a first index from at least one of temperature and humidity collected by the sensor;
Detecting the pulse rate from the image captured by the camera,
Using the first index and the pulse rate, determine whether there is a possibility of developing heat stroke,
A method for determining heat stroke, comprising performing a process of notifying a determination result. On the computer,
Calculating a first index from at least one of temperature and humidity collected by the sensor;
Detecting the pulse rate from the image captured by the camera,
Using the first index and the pulse rate, determine whether there is a possibility of developing heat stroke,
A heat stroke determination program characterized by causing a process to notify a determination result to be executed.

Images