JP6868422B6 - Physical condition estimation device, physical condition estimation system and processor - Google Patents

Description

The present invention relates to a physical condition estimation method, a physical condition estimation device, and a program.

Patent Document 1 discloses a technique for determining a person's physical condition such as stress, fatigue, drowsiness, and arousal level based on a pulse wave signal obtained by measuring a pulse wave generated by blood circulation.

JP-A-2002-272708

However, there are individual differences in pulse pressure. Therefore, the technique disclosed in Patent Document 1 has a problem that calibration (adjustment) such as setting the pulse pressure of an individual to be determined is required in advance, that is, before determining the physical condition.

Therefore, an object of the present invention is to provide a physical condition estimation method or the like capable of estimating a person's physical condition without requiring prior calibration.

In order to achieve the above object, the physical condition estimation device according to one embodiment of the present invention is a physical condition estimation device, which is based on a physiological amount acquisition unit for acquiring a person's physiological amount and the acquired physiological amount. A physical condition estimation processing unit that estimates a person's physical condition and generates a first physical condition information representing the estimated physical condition, and an estimation that acquires a first emotion information representing the person's emotion at the time when the physiological amount is acquired. The emotion acquisition unit and (1) generate the second physical condition information obtained by correcting the first physical condition information based on the first emotion information, and output the second physical condition information, or (2) the first physical condition. A correction unit that generates a second emotion information that corrects the first emotion information based on the information and outputs the second emotion information is provided.

It should be noted that these comprehensive or specific embodiments may be implemented in a system, method, integrated circuit, computer program or computer-readable recording medium such as a CD-ROM, system, method, integrated circuit, computer. It may be realized by any combination of a program and a recording medium.

In the physical condition estimation method of the present invention, the physical condition of a person can be estimated without the need for prior calibration.

FIG. 1 is a block diagram showing a configuration of a physical condition estimation device according to the first embodiment. FIG. 2 is a block diagram showing an example of a detailed configuration of the blood flow measuring unit in FIG. FIG. 3 is a block diagram showing an example of the detailed configuration of the physical condition estimation unit in FIG. FIG. 4 is a diagram showing an example of the Russell ring model. FIG. 5 is a diagram showing an example of output control of the physical condition estimation device in FIG. 1. FIG. 6 is a flowchart showing an outline of the operation of the physical condition estimation device shown in FIG. FIG. 7 is a diagram showing an example of output control of the physical condition estimation device according to the first embodiment. FIG. 8 is a flowchart showing an example of the output control method of the physical condition estimation device according to the first embodiment. FIG. 9 is a diagram showing an example of output control of the physical condition estimation device according to the second embodiment. FIG. 10 is a flowchart showing an example of an output control method of the physical condition estimation device according to the second embodiment. FIG. 11 is a flowchart showing an example of the output control method of the physical condition estimation device according to the third embodiment. FIG. 12 is a block diagram showing the configuration of the physical condition estimation device according to the second embodiment. FIG. 13 is a block diagram showing an example of the detailed configuration of the emotion estimation unit of FIG. FIG. 14A is a diagram showing an example of a usage mode of the Russell ring model used by the emotion estimation unit of FIG. FIG. 14B is a diagram showing an example of Schlossberg's conical model used by the emotion estimation unit 24 of FIG. FIG. 15 is a block diagram showing an example of the detailed configuration of the physical condition estimation unit of FIG. FIG. 16 is a flowchart showing an outline of the operation in the physical condition estimation device shown in FIG. FIG. 17 is a diagram showing an example of output control of the physical condition estimation device in the embodiment of the second embodiment. FIG. 18 is a diagram showing an example of output control of the physical condition estimation device according to the first modification of the second embodiment. FIG. 19 is a diagram showing an example of output control of the physical condition estimation device in the second modification of the second embodiment. FIG. 20 is a flowchart showing an example of an epilepsy attack estimation and output control method. FIG. 21 is a diagram for explaining one aspect of output control depending on the detection result of core body temperature. FIG. 22 is a flowchart showing an example of an output control method depending on the detection result of core body temperature.

The physical condition estimation method according to one aspect of the present invention is a physical condition estimation method executed by a computer, which includes a blood flow measurement step in which the computer simultaneously measures blood flow in at least two parts of a human body. The computer includes a physical condition estimation step of estimating the physical condition of the person based on the blood flow volume of the at least two sites measured in the blood flow measurement step.

According to the above aspect, even when the computer measures the blood flow rate of a person having individual differences and estimates the physical condition, the physical condition of the person can be estimated without the need for prior calibration.

Further, for example, in the blood flow measurement step, the blood flow rate of the first part that does not fluctuate depending on the physical condition of the person and the second part that fluctuates depending on the physical condition of the person is measured as the blood flow rate of the at least two parts. May be.

Here, for example, the first part may be the forehead of the person, and the second part is at least one of the lower part of the eyes, the nose, the lips, the limbs and the neck of the person. May be good.

Further, for example, in the blood flow measurement step, the blood flow rate of the person's forehead and the blood flow rate of the lower part of the eye of the person are measured as the blood flow rate of the at least two parts, and in the physical condition estimation step, the blood flow rate is described. As a person's physical condition, the sleep time of the person may be estimated.

Further, for example, in the blood flow measurement step, the blood flow rate of the person's forehead and the blood flow rate of one of the person's nose, lips, and limbs are measured as the blood flow rate of the at least two parts. However, in the physical condition estimation step, the degree of cold and heat felt by the person may be estimated as the physical condition of the person.

Further, for example, in the blood flow measurement step, the blood flow rate of the person's forehead and the blood flow rate of the person's neck are measured as the blood flow rate of the at least two parts, and in the physical condition estimation step, the person As the physical condition of the person, the presence or absence of stiff shoulders of the person may be estimated.

Further, for example, further, it is estimated in the physical condition estimation step based on the emotion estimation step of estimating the emotion of the person based on the physiological quantity of the person and the emotion of the person estimated in the emotion estimation step. It may include a correction step for correcting the physical condition of the person.

Here, for example, the physiological amount of the person may be the blood flow rate of one of the at least two sites.

Further, for example, the physiological amount of the person may be the blood flow rate of a part different from the at least two parts of the person's part.

Further, for example, the physiological amount of the person includes facial color, heart rate, heart rate fluctuation, LF / HF (Low Frequency / High Frequency) of heart rate fluctuation, RR interval, pulse wave, pulse fluctuation, brain wave, and the like. Respiratory rate, respiratory rate, blood flow, blood flow fluctuation, blood pressure, blood pressure fluctuation, oxygen saturation, body part movement, body muscle movement, facial muscle movement, body temperature, skin temperature, skin conductance, skin resistance , At least one of sweating amount and sweating rate may be included.

Further, for example, in the blood flow measurement step, the blood flow rate at at least two locations is measured in a non-contact manner by irradiating each of the at least two locations with light having a predetermined wavelength and receiving light having different wavelengths. May be good.

Here, for example, in the blood flow measurement step, the blood flow rate at at least two locations may be measured using a camera.

Further, the physical condition estimation device according to one aspect of the present invention includes a blood flow measuring unit that simultaneously measures the blood flow rate of at least two parts of a human part, and the at least two parts measured by the blood flow measuring unit. It is provided with a physical condition estimation unit that estimates the physical condition of the person based on the blood flow rate of the site.

It should be noted that these comprehensive or specific embodiments may be realized in a recording medium such as a system, method, integrated circuit, computer program or computer readable CD-ROM, system, method, integrated circuit, computer program. Alternatively, it may be realized by any combination of recording media.

Hereinafter, the physical condition estimation method and the like according to one aspect of the present invention will be specifically described with reference to the drawings. It should be noted that all of the embodiments described below show a specific example of the present invention. The numerical values, shapes, materials, components, arrangement positions of the components, etc. shown in the following embodiments are examples, and are not intended to limit the present invention. Further, among the components in the following embodiments, the components not described in the independent claims indicating the highest level concept are described as arbitrary components.

(Embodiment 1)
[Configuration of physical condition estimation device]
FIG. 1 is a block diagram showing the configuration of the physical condition estimation device 10 according to the first embodiment.

As shown in FIG. 1, the physical condition estimation device 10 includes a blood flow measurement unit 11, a physical condition estimation unit 12, and an output control unit 13. The physical condition estimation device 10 is realized by a computer or the like.

<Blood flow measurement unit 11>
FIG. 2 is a block diagram showing an example of the detailed configuration of the blood flow measuring unit 11 in FIG.

As shown in FIG. 2, the blood flow measurement unit 11 includes a camera unit 111 and a blood flow measurement processing unit 112, and simultaneously measures the blood flow rate of at least two parts of the human part. Here, the blood flow rate at at least two sites is a first site that does not fluctuate depending on the physical condition of the person and a second site that fluctuates depending on the physical condition of the person. For example, the first part is the forehead of a person and the second part is at least one of the lower part of the human eye, nose, lips, limbs and neck.

More specifically, the camera unit 111 is, for example, a laser speckle camera, a laser Doppler blood flow meter, or the like, and irradiates at least two locations with light having a predetermined wavelength to receive light having different wavelengths. The blood flow rate measurement processing unit 112 measures the blood flow rate at at least two locations in a non-contact manner based on the light of different wavelengths received by the camera unit 111.

The camera unit 111 may be composed of one camera as long as it can measure the blood flow at at least two locations at the same time, or may be composed of a device different from the camera such as a millimeter wave sensor and a pulse oximeter. You may be.

<Physical condition estimation unit 12>
FIG. 3 is a block diagram showing an example of the detailed configuration of the physical condition estimation unit 12 in FIG. FIG. 4 is a diagram showing an example of the Russell ring model.

As shown in FIG. 3, the physical condition estimation unit 12 includes a blood flow rate acquisition unit 121 and a physical condition estimation processing unit 122, and is based on the blood flow rate of at least two sites measured by the blood flow measurement unit 11. Estimate the physical condition of.

More specifically, the blood flow rate acquisition unit 121 acquires the blood flow rate at at least two sites measured by the blood flow measurement unit 11. The physical condition estimation processing unit 122 estimates a person's physical condition based on the blood flow rate of at least two sites acquired by the blood flow rate acquisition unit 121.

Here, as the blood flow rate of at least two parts, it is advisable to measure the blood flow rate of the first part that does not fluctuate depending on the physical condition of the person and the second part that fluctuates depending on the physical condition of the person. Further, as described above, for example, the first part is the forehead of a person, and the second part is at least one of the lower part of the human eye, the nose, the lips, the limbs and the neck. As a result, the physical condition estimation unit 12 can estimate the physical condition of a person from the blood flow rate of the second site based on the blood flow rate of the first site without the need for prior calibration.

In the present embodiment, the physical condition of a person refers to a state of mind and body other than emotion, which is the state of the person's mind defined by the Russell ring model, which is a two-dimensional model shown in FIG. Therefore, a person's physical condition includes, for example, sleeping hours, the degree of coldness such as hot and cold, coldness, stiff shoulders, facial stains, dry skin, and the like.

For example, when the blood flow measuring unit 11 measures the blood flow rate of the person's forehead and the blood flow rate of the lower part of the eyes of the person as the blood flow rate of at least two parts, the physical condition estimation unit 12 determines the physical condition of the person. , A person's sleep time may be estimated. When a person sleeps for a short time, bears occur and the blood flow in the lower part of the eye decreases. Therefore, the sleep time on the previous day (or the day) of the person can be estimated from the blood flow.

Further, for example, when the blood flow measuring unit 11 measures the blood flow rate of a person's forehead and the blood flow rate of one of the person's nose, lips, and limbs as the blood flow rate of at least two parts. The physical condition estimation unit 12 may estimate the degree of cold and heat felt by the person as the physical condition of the person. When it is hot, the temperature of the nose is relatively high compared to the forehead, and when it is cold, the opposite is true. Therefore, the degree of coldness felt by a person can be estimated from the blood flow.

Further, for example, when the blood flow measuring unit 11 measures the blood flow rate of the person's forehead and the blood flow rate of the neck of the person as the blood flow rate of at least two parts, the physical condition estimation unit 12 determines the physical condition of the person. As a result, the presence or absence of stiff shoulders of the person may be estimated. If the blood flow in the neck is relatively low in the blood flow between the forehead and the neck, stiff shoulders occur (or may occur), so the presence or absence of stiff shoulders in a person can be estimated from the blood flow. .. Here, as the physical condition of the person concerned, a headache may be estimated instead of stiff shoulders. When the blood flow in the neck is relatively low in the blood flow between the forehead and the neck, headaches are likely to occur in addition to stiff shoulders. Therefore, the presence or absence of a person's headache can be estimated from the blood flow.

Although the forehead is illustrated here as the first part, the forehead is not limited to the forehead. Even if it is another part, it may be a part where the fluctuation of blood flow is relatively small under the fluctuation of physical condition or the like, and may be, for example, the oral cavity or the eyeball.

In addition, the blood flow measuring unit 11 may measure the blood flow of the entire face of the same person every day. In this case, the physical condition estimation unit 12 has a stain on a part of the face of the person whose blood flow is locally reduced based on the amount of fluctuation of the blood flow measured daily as the physical condition of the person. It can be estimated that there is.

<Output control unit 13>
The output control unit 13 performs output control according to the physical condition of the person estimated by the physical condition estimation unit 12.

FIG. 5 is a diagram showing an example of output control of the physical condition estimation device 10 in FIG. FIG. 5 shows an example in which the sleep time of the previous day estimated from the blood flow between the forehead of the person 50 and the lower part of the eye is output to the display surface 61 of the mobile terminal 60 such as the smartphone of the person 50. There is.

The output control of the physical condition estimation device 10 (output control unit 13) is not limited to the example shown in FIG. 5, and includes, for example, output control such as the following display control, notification control, and device control.

(time of sleeping)
For example, the output control unit 13 may predict when the person is likely to become sleepy today based on the sleep time estimated by the physical condition estimation unit 12 as the physical condition of the person. Then, when the physical condition estimation device 10 is mounted on the car, the output control unit 13 may send a notification prompting a break to the car navigation screen or the user's mobile terminal when the time is approached. Further, assuming that the physical condition estimation device 10 is installed in the space where the person is present, the output control unit 13 may brighten the lighting to promote awakening when the time is approached.

Further, when the output control unit 13 determines that the cumulative sleep time estimated by the physical condition estimation unit 12 is short, the output control unit 13 may notify the company in which the person works to encourage rest.

Further, the output control unit 13 expresses the sleep time estimated by the physical condition estimation unit 12 as the current concentration ratio and productivity of the person, and notifies the person via a mobile terminal such as a smartphone. May be good.

The output control unit 13 may determine not only the sleep time of the previous day estimated by the physical condition estimation unit 12 but also the sleep time of a plurality of days including the previous day as the sleep time.

Further, the output control unit 13 may set the insurance premium of the person based on the sleep time of a plurality of days estimated by the physical condition estimation unit 12 and notify the person. Here, the insurance premium refers to the insurance premium for life insurance, automobile insurance, and the like. If the sleep time is shorter than the prescribed time, the possibility of drowsy driving increases and the risk of getting a lifestyle-related disease increases. May be notified to.

(Degree of cold and heat, presence or absence of stiff shoulders, etc.)
Further, the output control unit 13 controls the air volume, air temperature, wind direction, etc. of the air conditioner in the space where the person is present, according to the degree of coldness such as hot or cold estimated by the physical condition estimation unit 12 as the physical condition of the person. You may.

Further, when the physical condition estimation unit 12 estimates that the person has stiff shoulders as the physical condition of the person, the output control unit 13 prevents the stiff shoulders and reduces the stiff shoulders when the physical condition estimation device 10 is mounted on the car. In addition, the seat heater of the car may be controlled to heat the shoulder area.

In addition, the output control unit 13 expresses the degree of stiff shoulders estimated by the physical condition estimation unit 12 as the degree of concentration and productivity of the person today, and notifies the person via a mobile terminal such as a smartphone. You may. Further, when the output control unit 13 confirms that the degree of stiff shoulders estimated by the physical condition estimation unit 12 is severe or that stiff shoulders occur frequently, the output control unit 13 informs that a massage or a clinic should be performed. It may be proposed to the person himself / herself via a mobile terminal such as, a method for alleviating the stiff shoulder may be proposed, or a means for alleviating stiff shoulders may be proposed by other means.

Further, when the output control unit 13 estimates that the physical condition estimation unit 12 has a stain on the face as a person's physical condition, the output control unit 13 informs that the massage or the like should be performed via a mobile terminal such as a smartphone. It may be proposed to the person himself / herself, a method for alleviating the stain may be proposed, or a means for alleviating the stain may be proposed by other means.

[Operation of physical condition estimation device 10]
Next, the operation of the above-mentioned physical condition estimation device 10 will be described with reference to FIG. FIG. 6 is a flowchart showing an outline of the operation of the physical condition estimation device 10 shown in FIG. The operation of the physical condition estimation device 10 is executed by a computer included in the physical condition estimation device 10.

First, the physical condition estimation device 10 simultaneously measures the blood flow rate of at least two parts of the human part (S11). Next, the physical condition estimation device 10 estimates the physical condition of the person based on the measured blood flow rate at at least two sites (S12). Then, the physical condition estimation device 10 performs output control according to the estimated physical condition (S13).

[Effects, etc.]
As described above, according to the physical condition estimation method and the like in the present embodiment, even when the computer measures the blood flow rate having individual differences and estimates the physical condition, a person does not need to be calibrated in advance. You can estimate your physical condition.

More specifically, the physical condition estimation method and the physical condition estimation device in the present embodiment have blood flow rates in at least two parts of the human part, such as a part that does not fluctuate with the human physical condition and a part that fluctuates with the human physical condition. Are measured at the same time. This makes it possible to estimate a person's physical condition based on the measured blood flow rate at at least two sites without the need for prior calibration.

In the above embodiment, the physical condition of a person has been described as including, for example, sleeping hours, the degree of coldness such as hot and cold, coldness, stiff shoulders, facial stains, dry skin, and the like. Is not limited to these. As a person's physical condition, including the level of wanting to go to the toilet, the level of motion sickness, the risk of heat shock, the risk of increased blood pressure during defecation, the level of drunkenness, driving skill, hunger level, fatigue level, depression level, etc. May be good. Hereinafter, these examples will be described as Examples 1 to 9.

(Example 1)
In the first embodiment, a case of estimating the level at which one wants to go to the toilet as a person's physical condition will be described.

FIG. 7 is a diagram showing an example of output control of the physical condition estimation device 10 in the first embodiment. FIG. 8 is a flowchart showing an example of the output control method of the physical condition estimation device 10 in the first embodiment.

In this embodiment, for example, the physical condition estimation device 10 measures the blood flow rate of the person's forehead and the blood flow rate of the lower part of the eye of the person as the blood flow rate of at least two parts, and the measured amount of blood flow and the blood flow rate. Based on the blood flow in the lower part of the eye of the person, the level at which the person wants to go to the toilet is estimated as the physical condition of the person. When a person is tense due to wanting to go to the toilet, the blood flow rate between the forehead and the lower part of the eye is relatively low, so that the level at which the person wants to go to the toilet can be estimated.

Assuming that the physical condition estimation device 10 according to the present embodiment is mounted on the vehicle, the physical condition estimation device 10 according to the present embodiment estimates that the level at which the person wants to go to the toilet is equal to or higher than the threshold value. As shown in FIG. 7, the public toilet 71 may be displayed on the car navigation screen 70 to guide the route to the public toilet 71.

Further, as shown in FIG. 8, the physical condition estimation device 10 estimates the level at which the person wants to go to the toilet (S121), and when the estimated level at which the person wants to go to the toilet is lower than the threshold value (in S131). No), you may guide a clean toilet (S132) even if it is a little far away as long as it is within a predetermined distance. On the other hand, if the estimated level at which the person wants to go to the toilet is higher than the threshold value (Yes in S131), the person may be guided to a vacant and close toilet regardless of the cleanliness of the toilet (S133).

In this way, the physical condition estimation device 10 may change the guidance method according to the estimated level at which the person wants to go to the toilet.

The method of estimating the level at which a person wants to go to the toilet as a person's physical condition is not limited to the method based on the blood flow rate of two or more parts as described above. The level at which you want to go to the bathroom may be estimated from the fluctuations in the heart rate, blood pressure, and facial expressions of the person. When a person wants to go to the bathroom, his / her heart rate rises, his / her blood pressure rises, and his / her facial expression becomes enduring (for example, clenching his / her teeth). Can be estimated. Here, the level at which a person wants to go to the toilet may be estimated using all of the heartbeat, blood pressure, and facial expression, or even if one of them is used, a combination of a plurality of toilets may be used. You may estimate the level you want to go to.

(Example 2)
In the second embodiment, a case where the motion sickness level is estimated as a person's physical condition will be described.

FIG. 9 is a diagram showing an example of output control of the physical condition estimation device 10 in the second embodiment. FIG. 10 is a flowchart showing an example of the output control method of the physical condition estimation device 10 in the second embodiment.

In this embodiment, for example, the physical condition estimation device 10 measures the blood flow rate of the person's forehead and the blood flow rate of the lower part of the eye of the person as the blood flow rate of at least two parts, and the measured amount of blood flow and the blood flow rate. Based on the blood flow in the lower part of the eye of the person, the ride sickness level of the person is estimated as the physical condition of the person. When a person becomes tense due to motion sickness or the like, the blood flow rate in the lower part of the eye is relatively reduced in the blood flow rate between the forehead and the lower part of the eye. Therefore, the physical condition estimation device 10 can estimate the motion sickness level of the person. ..

Assuming that the physical condition estimation device 10 is mounted on the car, when the physical condition estimation device 10 estimates that the level of motion sickness of the person is equal to or higher than the threshold value, the car navigation screen 70 is displayed on the car navigation screen 70 as shown in FIG. The parking area 72 for taking a break may be displayed to guide the route to that area. Of course, the method of communicating the situation of the person concerned to the driver is not limited to this. For example, the situation of the person concerned is notified to the driver by displaying the fact on the car navigation screen 70 or the instrument panel (instrument panel), or by transmitting the fact by voice through a mobile terminal such as a driver or a speaker in the car. The method may be used.

For example, as shown in FIG. 10, the physical condition estimation device 10 estimates the motion sickness level of the person (S121A), and when the estimated motion sickness level of the person is lower than the threshold value (No in S131A), S11. You may return to and estimate the motion sickness level of the person after a certain period of time. On the other hand, when the estimated motion sickness level of the person is higher than the threshold value (Yes in S131A), a device control signal for controlling devices such as a car brake, an accelerator, and an active suspension may be output (S133A).

As a result, the sensitivity of the accelerator and the brake can be lowered to reduce sudden start and acceleration so that the person does not get drunk any more, and the active suspension can be softened to reduce the vibration applied to the body. In addition, by controlling the device in this way, even if the person is a child and cannot say that he / she has motion sickness, it is possible to prevent the person from vomiting in the car or increasing the level of motion sickness. it can. Furthermore, if the car is a taxi, it is possible to prevent the inconvenience caused by the taxi by dropping the customer before the customer vomits or refusing to board the customer. it can.

As a person's physical condition, the method of estimating the motion sickness level of the person is not limited to the method based on the blood flow rate of two or more parts as described above. The motion sickness level may be estimated from the facial expression of the person and the heart rate and blood pressure information. When a person gets motion sickness, his facial expression becomes pale or he feels sick, and the correlation (ρmax) between the increase and decrease of heart rate and the increase and decrease of blood pressure in the time series decreases. The level of motion sickness of a person can be estimated. here,
A person's motion sickness level may be estimated using both ρmax and facial expression, or a person's motion sickness level may be estimated using any one of them.

(Example 3)
In the third embodiment, a case where the risk of heat shock is estimated as a person's physical condition will be described. Here, heat shock refers to vascular disorders such as fainting, myocardial infarction, and cerebral infarction that occur due to sudden blood pressure fluctuations. In many cases, heat shock occurs mainly due to a sudden rise in blood pressure when undressing in a cold dressing room before bathing or a sudden rise in blood pressure when bathing in hot water.

In this embodiment, the physical condition estimation device 10 measures, for example, the blood flow rate of the person's forehead and the blood flow rate of the lower part of the eye of the person as the blood flow rate of at least two parts, and the measured amount of blood flow and the blood flow rate. Based on the blood flow in the lower part of the eye of the person, the risk of the person to heat shock is estimated as the physical condition of the person. In the blood flow between the forehead and the lower part of the eye, the blood flow in the lower part of the eye is relatively low when it is cold, and the blood flow in the lower part of the eye is relatively high when it is hot. The risk to the patient can be estimated.

FIG. 11 is a flowchart showing an example of the output control method of the physical condition estimation device 10 in the third embodiment.

For example, as shown in FIG. 11, the physical condition estimation device 10 estimates the risk of the person to heat shock (S121C), and when the estimated risk of heat shock of the person is lower than the threshold value (in S131C). No), returning to S11, the risk of the person concerned against heat shock may be estimated after a certain period of time. On the other hand, when the estimated risk of heat shock of the person is higher than the threshold value (Yes in S131C), a device control signal including an instruction to turn on the heating is output in order to raise the temperature around the person. It may be done (S133C).

As a result, sudden fluctuations in blood pressure of the person can be prevented, and heat shock can be prevented.

The output control method of the physical condition estimation device 10 when the estimated risk of heat shock of the person is higher than the threshold value is not limited to the above-mentioned method. For example, if the person is in a dressing room or a toilet, the person may be notified to that effect and encouraged to operate the heating. Further, for example, the physical condition estimation device 10 is a device including an instruction such as adding water to the hot water when the estimated risk of heat shock of the person is higher than the threshold value when the person takes a bath in the bathroom. A control signal may be output. As a result, sudden fluctuations in blood pressure can be prevented by lowering the temperature of the hot water in which the person is bathing.

As a person's physical condition, the method of estimating the risk of heat shock of the person is not limited to the method based on the blood flow rate of two or more parts as described above. The risk of heat shock may be estimated from the blood pressure information of the person. If the blood pressure can be constantly measured, it can be estimated that the risk of heat shock increases, for example, when the blood pressure reaches a predetermined value or higher.

Here, a plurality of threshold values may be set instead of the predetermined values, and the risk level against heat shock may be estimated step by step. The blood pressure threshold for determining the increased risk of heat shock can be adjusted based on the degree of arteriosclerosis. The degree of arteriosclerosis can be estimated from the pulse pressure (maximum blood pressure and minimum blood pressure) or from the pulse wave velocity, regardless of the means.

Further, the blood pressure threshold value is not limited to the case of adjusting from the degree of arteriosclerosis, and may be adjusted based on age or may be adjusted based on the amount of water in the body. This is because when the amount of water in the body is reduced, the blood pressure fluctuates rapidly, and thus heat shock is likely to occur. If it can be determined that the risk of heat shock is increasing, adjustments may be made by other methods.

The degree of arteriosclerosis may be manually input based on the results of a medical examination without detecting it in a non-contact manner, and similarly, the age may be manually input.

In addition, if blood pressure can be measured at all times, warnings and notifications such as warnings may be issued according to the degree of arteriosclerosis and water content, and the blood pressure fluctuation of the person is within the reach of the person. You may display it.

(Example 4)
In Example 4, a case of estimating the degree of risk due to an increase in blood pressure during defecation as a person's physical condition will be described. At the time of defecation, a person generates a strain to promote excretion, and this strain may increase blood pressure, which may cause vascular disorders such as fainting, myocardial infarction, and cerebral infarction.

In this embodiment, the physical condition estimation device 10 measures, for example, the blood flow rate of the person's forehead and the blood flow rate of the lower part of the eye of the person as the blood flow rate of at least two parts, and the measured amount of blood flow and the blood flow rate. Based on the blood flow in the lower part of the eye of the person, the risk of the person's physical condition due to an increase in blood pressure during defecation is estimated. In the blood flow between the forehead and the lower part of the eye, the blood flow in the lower part of the eye relatively increases due to defecation during defecation, so that the risk of the increase in blood pressure during defecation can be estimated.

Then, when the physical condition estimation device 10 according to the present embodiment estimates that the risk level due to the increase in blood pressure during defecation of the person is equal to or higher than a predetermined value, the physical condition estimation device 10 may notify the user to that effect and prompt the user to reduce the shower. Alternatively, the warm water washing toilet seat may be controlled by a device, and water may be sprinkled in the vicinity of the anus with a shower to reduce the swelling and promote defecation.

As a result, it is possible to prevent sudden fluctuations in blood pressure of the person concerned and prevent vascular disorders from occurring.

As for the physical condition of a person, the method of estimating the degree of risk due to an increase in blood pressure during defecation of the person is not limited to the method based on the blood flow rate of two or more sites as described above. From the blood pressure information of the person concerned, the degree of risk due to an increase in blood pressure during defecation may be estimated. If the blood pressure can be constantly measured, it can be estimated that, for example, when the blood pressure reaches a predetermined value or higher, the risk due to the increase in blood pressure during defecation increases.

Here, a plurality of threshold values may be set instead of predetermined values, and the risk level due to an increase in blood pressure during defecation may be estimated stepwise. The blood pressure threshold for determining that the risk of increased blood pressure during defecation is increasing can be adjusted based on the degree of arteriosclerosis. The degree of arteriosclerosis can be estimated from the pulse pressure (maximum blood pressure and minimum blood pressure) or from the pulse wave velocity, but the means is not limited.

Further, the blood pressure threshold value is not limited to the case of adjusting from the degree of arteriosclerosis, and may be adjusted based on age or may be adjusted based on the amount of water in the body. This is because when the amount of water in the body is reduced, the blood pressure fluctuates rapidly, and thus heat shock is likely to occur. If it can be determined that the risk of heat shock is increasing, adjustments may be made by other methods.

The degree of arteriosclerosis may be manually input based on the results of a medical examination without detecting it in a non-contact manner, and similarly, the age may be manually input.

In addition, if blood pressure can be measured at all times, warnings and notifications such as warnings may be issued according to the degree of arteriosclerosis and water content, and the blood pressure fluctuation of the person is within the reach of the person. You may display it.

(Example 5)
In the fifth embodiment, a case where the drunkenness level is estimated as a person's physical condition will be described.

In this embodiment, the physical condition estimation device 10 measures, for example, the blood flow rate of the person's forehead and the blood flow rate of the lower part of the eye of the person as the blood flow rate of at least two parts, and the measured amount of blood flow and the blood flow rate. Based on the blood flow in the lower part of the eye of the person, the drunkenness level of the person is estimated as the physical condition of the person. In terms of blood flow between the forehead and the lower part of the eye, when a person gets drunk, the blood flow in the lower part of the eye increases relatively, and when he feels sick due to drunkenness, the blood flow in the lower part of the eye is relative. The level of drunkenness of the person can be estimated from the decrease to.

Then, when the physical condition estimation device 10 according to the present embodiment estimates that the drunkenness level of the person is equal to or higher than a predetermined value, that is, the person is in a drunken state, the physical condition estimation device 10 according to the present embodiment is a vehicle. When it is mounted on the vehicle, it may be controlled (equipment control) so that the engine of the automobile cannot be started. As a result, it is possible to prevent the person concerned from driving a car in a drunken state.

Further, when the physical condition estimation device 10 according to the present embodiment estimates that the person's drunkenness level is equal to or higher than a predetermined value, that is, the person is drinking too much, the physical condition estimation device 10 notifies the user to that effect or notifies the user of the person's drunkenness level. It may be displayed. As a result, the person can be made aware of his / her own excessive drinking level, and the person can be prevented from drinking too much.

As for the physical condition of a person, the method of estimating the level of drunkenness of the person is not limited to the method based on the blood flow rate of two or more parts as described above. The level of drunkenness of the person may be estimated from the facial expression of the person, heart rate, blood pressure information, blood flow, and exhaled breath information. When a person becomes drunk, his / her eyes become uncertain, his / her blood circulation improves and his / her heart rate rises, his / her complexion becomes red, his / her blood pressure drops due to being drunk and relaxed, and alcohol in exhaled breath. The level of drunkenness of the person can be estimated from the increase in concentration. Then, the drunkenness level of the person concerned may be estimated by using all of these information, or any one of them may be used, or a combination of a plurality of them may be used for estimation.

(Example 6)
In the sixth embodiment, a case where the driving skill is estimated as the physical condition of the person will be described.

In this embodiment, the physical condition estimation device 10 measures, for example, the blood flow rate of the person's forehead and the blood flow rate of the lower part of the eye of the person as the blood flow rate of at least two parts, and the measured amount of blood flow and the blood flow rate. Based on the blood flow in the lower part of the eye of the person, the driving skill of the person is estimated as the physical condition of the person. In terms of blood flow between the forehead and the lower part of the eye, a person does not get nervous if the person's driving skill is high and there is room for driving, so the blood flow in the lower part of the eye is relatively high, and the person's driving skill is low and there is no room for driving. Since the blood flow in the lower part of the eye is relatively reduced, the driving skill of the person can be estimated.

Then, when it is estimated that the driving skill of the person concerned is lower than a predetermined value, that is, there is no margin for driving, the physical condition estimation device 10 according to the present embodiment controls the device to increase the sensitivity of the brake and increases the inter-vehicle distance. You may want to keep the speed modest by controlling the device to keep it or reduce the sensitivity of the accelerator. As a result, even if the person's driving skill is low and there is no margin, it is possible to lead to driving with a lot of margin.

As a person's physical condition, the method of estimating the driving skill of the person is not limited to the method based on the blood flow rate of two or more parts as described above. The driving skill of the person may be estimated from the fluctuation of the person's facial expression and heart rate. The amount of margin for driving can be estimated from the facial expression of a person, and if a person is nervous while driving, the fluctuation of the heart rate will be small, and if there is a margin during driving, the fluctuation of the heart rate will be large. It is possible to estimate a person's driving skill. All of this information may be used to estimate the driving skill of the person concerned, or any one of them may be used, or a combination of a plurality of them may be used for estimation.

When the physical condition estimation device 10 according to the present embodiment is mounted on a car and the physical condition of a person is estimated based on the facial expression of the person, fear may be estimated as the physical condition of the person. For example, the physical condition estimation device 10 according to the present embodiment estimates whether or not there is fear from the facial expression of the passenger of the car, who is the person concerned, when the car is automatically driven. Then, if it is presumed that the person is scared, that is, the person cannot afford it (autonomous driving is unreliable), the vehicle equipment may be controlled to set a large inter-vehicle distance and a low speed. .. This can give a sense of security to the person on board.

Furthermore, when the physical condition estimation device 10 according to the present embodiment recognizes that the occupant is looking at the vehicle window during automatic driving based on the facial expression of the person concerned, the vehicle is designed to reduce the speed of the vehicle. Equipment may be controlled. By doing so, the person can look at the car window slowly.

(Example 7)
In Example 7, a case where the hunger level is estimated as a person's physical condition will be described.

In this embodiment, the physical condition estimation device 10 measures, for example, the blood flow rate of the person's forehead and the blood flow rate of the lower part of the eye of the person as the blood flow rate of at least two parts, and the measured amount of blood flow and the blood flow rate. Based on the blood flow in the lower part of the eye of the person, the hunger level of the person is estimated as the physical condition of the person. In the blood flow between the forehead and the lower part of the eye, when the hunger level of the person becomes higher, stress is applied and the blood flow in the lower part of the eye is relatively lowered, so that the hunger level of the person can be estimated.

Assuming that the physical condition estimation device 10 according to the present embodiment is installed in the office, the physical condition estimation device 10 according to the present embodiment estimates that the hunger level of the person is equal to or higher than a predetermined value, that is, the feeling of hunger of the person. In this case, the lighting may be controlled (equipment control) so as to increase the amount of the blue component contained in the lighting. This is because seeing blue light has the effect of reducing the feeling of hunger.

Further, assuming that the physical condition estimation device 10 according to the present embodiment is mounted on the vehicle, the physical condition estimation device 10 according to the present embodiment estimates that the hunger level of the person is equal to or higher than a predetermined value, that is, the feeling of hunger of the person. In this case, the car navigation screen may display a restaurant near the current location and guide the route to that location.

As a person's physical condition, the method of estimating the hunger level of the person is not limited to the method based on the blood flow rate of two or more parts as described above. The hunger level of the person may be estimated from the blood glucose level of the person, the exhaled breath information, and the sound of the abdomen. A person's hunger level is estimated from the decrease in blood glucose level when hungry, the increase in the amount of acetone contained in exhaled breath, and the increase in abdominal sound due to active gastrointestinal activity. be able to. Then, the hunger level of the person concerned may be estimated by using all of these information, or any one of them may be used, or a combination of a plurality of them may be used for estimation.

(Example 8)
In Example 8, a case where the fatigue level is estimated as a person's physical condition will be described.

In this embodiment, the physical condition estimation device 10 measures, for example, the blood flow rate of the person's forehead and the blood flow rate of the lower part of the eye of the person as the blood flow rate of at least two parts, and the measured amount of blood flow and the blood flow rate. Based on the blood flow in the lower part of the eye of the person, the fatigue level of the person is estimated as the physical condition of the person. A person is stressed when the fatigue level is high, and the blood flow rate in the lower part of the eye is relatively low in the blood flow rate between the forehead and the lower part of the eye, so that the fatigue level of the person can be estimated.

Assuming that the physical condition estimation device 10 according to the present embodiment is mounted on the vehicle, the physical condition estimation device 10 according to the present embodiment is in the vehicle when it is estimated that the fatigue level of the person is equal to or higher than a predetermined value. The device may be controlled to prompt a break by voice, or the driver may be controlled to switch to automatic driving so that the fatigue of the driver concerned does not increase any more.

As a person's physical condition, the method of estimating the fatigue level of the person is not limited to the method based on the blood flow rate of two or more parts as described above. The fatigue level of the person may be estimated from the facial expression of the person, the oxygen saturation in the bloodstream, and the lactic acid concentration. When a person becomes tired, the oxygen saturation in the blood decreases, the lactic acid concentration increases, and a feeling of fatigue appears in the facial expression, so that the person's fatigue level can be estimated. Then, the fatigue level of the person may be estimated by using all of these information, or any one of them may be used, or a combination of a plurality of them may be used for estimation.

(Example 9)
In Example 9, a case where the depression level is estimated as a person's physical condition will be described.

In this embodiment, the physical condition estimation device 10 measures, for example, the blood flow rate of the person's forehead and the blood flow rate of the lower part of the eye of the person as the blood flow rate of at least two parts, and the measured amount of blood flow and the blood flow rate. Based on the blood flow in the lower part of the eye of the person, the depression level of the person is estimated as the physical condition of the person. A person is stressed when the depression level is high, and the blood flow in the lower part of the eye is relatively low in the blood flow between the forehead and the lower part of the eye, so that the depression level of the person can be estimated.

Then, the physical condition estimation device 10 according to the present embodiment may control the lighting of the room when it is estimated that the depression level of the person is equal to or higher than a predetermined value, that is, the depression state. By controlling the lighting of the room, for example, brightening the morning and darkening the night, the circadian rhythm of the person can be adjusted and the depression can be alleviated. When the physical condition estimation device 10 according to the present embodiment estimates that the person's depression level is equal to or higher than a predetermined value, that is, is in a depressed state, the physical condition estimation device 10 plays energetic music in the morning and relaxed music in the evening. The music device may be controlled to play.

As a person's physical condition, the method of estimating the depression level of the person is not limited to the method based on the blood flow rate of two or more parts as described above. The depression level of the person may be estimated from the facial expression of the person and the heartbeat interval. It is known that when a person becomes depressed, the rate of parasympathetic nerve enhancement decreases with respect to the fluctuation of the autonomic nerve during the day, and by examining the time-series fluctuation of the heartbeat interval, the sympathetic nerve and the sympathetic nerve Since the rate of parasympathetic nerve hyperactivity can be examined, the depression level of the person can be estimated. In addition, it is known that when a person becomes depressed, a facial expression peculiar to the depressed state (for example, an expressionless expression without a viewpoint) is seen, for example, a facial expression at a predetermined timing such as when waking up, or a predetermined facial expression. Depression can be estimated from the change in facial expression when the image is shown. The depression level of the person may be estimated using all of this information, or any one of them may be used, or a combination of a plurality of them may be used for estimation.

(Embodiment 2)
In the first embodiment, the case where the physical condition of a person is estimated based on the physiological amount of the person such as the blood flow rate of at least two parts of the human part has been described, but the present invention is not limited to this. The physical condition of a person may be estimated by estimating the physical condition of the person based on the physiological amount of the person and further correcting the physical condition of the person based on the emotion of the person at the time when the physiological amount is acquired. Hereinafter, this case will be described as the second embodiment.

[Configuration of physical condition estimation device]
FIG. 12 is a block diagram showing the configuration of the physical condition estimation device 20 according to the second embodiment. The same elements as those in FIG. 1 and the like are designated by the same reference numerals, and detailed description thereof will be omitted.

As shown in FIG. 12, the physical condition estimation device 20 includes a blood flow measurement unit 11, a physical condition estimation unit 22, an output control unit 13, and an emotion estimation unit 24. This physical condition estimation device 20 is realized by a computer or the like. In the physical condition estimation device 20 shown in FIG. 12, an emotion estimation unit 24 is added to the physical condition estimation device 10 according to the first embodiment, and the configuration of the physical condition estimation unit 22 is different.

<Emotion estimation unit 24>
The emotion estimation unit 24 estimates the emotion of the person based on the physiological amount of the person. More specifically, the emotion estimation unit 24 estimates the emotion of the person using the Russell ring model shown in FIG. 4 based on the physiological quantity of the person. Here, the physiological amount is data related to the function of the living body, for example, face color, heart rate, heart rate fluctuation, LF / HF (Low Frequency / High Frequency) of heart rate fluctuation, RR interval, pulse wave. , Pulse fluctuation, brain wave, respiratory rate, respiratory volume, blood flow, blood pressure fluctuation, blood pressure, blood pressure fluctuation, oxygen saturation (SpO ₂ ), body part movement, body muscle movement, facial muscle movement, Includes at least one of body temperature, skin temperature, skin conductance, skin resistance, skin roughness, skin shine, sweat rate and sweat rate. Here, examples of the movement of a body part include the frequency and speed of blinking.

Therefore, the emotion estimation unit 24 estimates the emotion of the person, such as the arousal level of the person, based on the blood flow rate of at least one of the two parts measured by the blood flow measurement unit 11 as the physiological amount of the person. You may. Further, the emotion estimation unit 24 is based on the blood flow rate of a part different from at least two parts measured by the blood flow measurement unit 11 among the human parts as the physiological amount of the person, for example, the arousal degree of the person. You may estimate a person's emotions. In addition, the emotion estimation unit 24 is based on a person's physiological amount other than blood flow, for example, facial expressions, heart rate, respiration, pulse wave, blood pressure, and other physiological amounts, and a combination thereof. Emotions may be estimated.

In addition, the emotion estimation unit 24 uses the Russell ring model shown in FIG. 4 to set the axis of comfort and discomfort in the facial expression, such as blood flow, heartbeat, respiration, pulse wave, blood pressure, etc. Therefore, the axis of arousal and drowsiness may be determined to estimate a person's emotions. This will be described below.

FIG. 13 is a block diagram showing an example of the detailed configuration of the emotion estimation unit 24 of FIG. FIG. 14A is a diagram showing an example of a usage mode of the Russell ring model used by the emotion estimation unit 24 of FIG. FIG. 14B is a diagram showing an example of Schlossberg's conical model used by the emotion estimation unit 24 of FIG.

As shown in FIG. 13, the emotion estimation unit 24 includes a camera unit 241, a facial expression estimation unit 242, an emotion estimation processing unit 243, and a storage unit 244.

People have various emotions such as joy or surprise. In the Russell ring model shown in FIG. 4, various emotions held by a person are arranged on a plane composed of an axis of comfort and discomfort and an axis of arousal and drowsiness. The Russell ring model shows that various emotions held by a person can be arranged in a ring shape in the plane shown in FIG. The axis of arousal and drowsiness may be difficult to appear in a person's facial expression, but it can be calculated based on the physiological amount described above such as the person's heart rate. On the other hand, the axis of comfort and discomfort may be calculated from a person's facial expression or the like. By doing so, it is possible to estimate a person's emotions more accurately than to estimate emotions only from facial expressions or physiological quantities.

The storage unit 244 stores data corresponding to the Russell ring model as shown in FIG. 14, for example.

The camera unit 241 photographs the entire face of the person. The facial expression estimation unit 242 estimates the facial expression of the person based on the face of the person photographed by the camera unit 241.

The emotion estimation processing unit 243 refers to the data stored in the storage unit 244, for example, corresponding to the Russell ring model shown in FIG. The emotion estimation processing unit 243 determines the position on the axis of comfort and discomfort based on the facial expression of the person estimated by the facial expression estimation unit 242, and from the blood flow rate of the person's part measured by the blood flow measurement unit 11, The emotion of the person may be estimated by determining the position of the awake sleep on the axis. Further, as described above, the emotion estimation processing unit 243 may determine the position on the axis of awake sleepiness from physiological data such as heartbeat, respiration, pulse wave, and blood pressure. For example, the emotion estimation processing unit 243 may estimate the heart rate of the person from the weak variation of the person's complexion estimated by the facial expression estimation unit 242, and determine the position on the axis of awake sleepiness. Needless to say, such a method of obtaining emotions is not limited to the case where it is applied when correcting the estimated physical condition, and can also be applied when only the emotions are obtained.

Although the case of estimating emotions in the Russell ring model has been described here, other models may be used. For example, in the Schlossberg conical model shown in FIG. 14B, for example, the arousal level of sleep tension may be calculated based on the physiological amount, and the pleasant-discomfort and attention-rejection axes in the ring may be estimated from facial expressions. -The rejection axis may also be calculated based on the physiological amount. This makes it possible to estimate emotions more accurately.

<Physical condition estimation unit 22>
FIG. 15 is a block diagram showing an example of the detailed configuration of the physical condition estimation unit 22 of FIG. The same elements as those in FIG. 3 are designated by the same reference numerals, and detailed description thereof will be omitted.

As shown in FIG. 15, the physical condition estimation unit 22 includes a blood flow rate acquisition unit 121, a physical condition estimation processing unit 122, an estimated emotion acquisition unit 223, and a correction unit 224, and at least measured by the blood flow measurement unit 11. A person's physical condition is estimated based on the blood flow at two sites. The physical condition estimation unit 22 shown in FIG. 15 has an additional configuration of an estimated emotion acquisition unit 223 and a correction unit 224, as compared with the physical condition estimation unit 12 shown in FIG. 3 in the first embodiment.

More specifically, the estimated emotion acquisition unit 223 acquires the emotion of the person estimated by the emotion estimation unit 24. The correction unit 224 corrects the physical condition of the person estimated by the physical condition estimation processing unit 122 based on the emotion of the person estimated by the emotion estimation unit 24.

Here, for example, a case where the physical condition estimation processing unit 122 estimates "stiff shoulders" as the physical condition of the person at a predetermined level and the emotion estimation unit 24 estimates "excitement" as the emotion of the person will be described as an example. To do. Since "excitement" contributes to increasing the blood flow of the person and reducing stiff shoulders, the correction unit 224 can correct the physical condition of the person as "stiff shoulders" at a level lower than the predetermined level. .. In this way, the physical condition estimation unit 22 can use the person's physical condition corrected based on the person's emotions as the estimation result.

[Operation of physical condition estimation device 20]
Next, the operation of the above-mentioned physical condition estimation device 20 will be described with reference to FIG. FIG. 16 is a flowchart showing an outline of the operation of the physical condition estimation device 20 shown in FIG. The operation of the physical condition estimation device 20 is executed by the computer included in the physical condition estimation device 20.

First, the physical condition estimation device 20 simultaneously measures the blood flow rate of at least two parts of the human part (S21). Next, the physical condition estimation device 20 estimates the physical condition of the person based on the measured blood flow rate at at least two sites (S22). Next, the physical condition estimation device 20 estimates the emotion of the person based on the blood flow rate at at least one site (S23). Here, the blood flow rate at one site for estimating a person's emotion may be a site measured for estimating physical condition, or may be another site. Next, the physical condition estimation device 20 corrects the physical condition of the person estimated in S22 based on the emotion of the person estimated in S23 (S24). Then, the physical condition estimation device 20 performs output control according to the corrected physical condition (S25).

[Effects, etc.]
As described above, according to the physical condition estimation method and the like in the present embodiment, even when the computer measures the blood flow rate having individual differences and estimates the physical condition, the person's physical condition does not need to be calibrated in advance. You can estimate your physical condition. Further, according to the physical condition estimation method or the like in the present embodiment, the estimated physical condition can be corrected based on the human emotion, so that the physical condition of the person in consideration of the human emotion can be estimated.

Here, as an example, a case where the estimated physical condition is the level of stiff shoulders and the estimated emotion is the degree of excitement will be described.

(Example)
FIG. 17 is a diagram showing an example of output control of the physical condition estimation device 20A in the embodiment of the second embodiment.

In this embodiment, for example, the blood flow measuring unit 11A has the blood flow rate A of the forehead A of the person 50, the blood flow rate B of the neck B of the person 50, and the nose C of the person 50 as the blood flow rate of at least two sites. Blood flow rate C is measured. The emotion estimation unit 24A estimates the degree of excitement of the person 50 as the emotion of the person 50 based on the measured blood flow rate C of the nose C.

First, the physical condition estimation unit 22 estimates the level of stiff shoulders of the person 50 as the physical condition of the person 50 based on the measured blood flow A of the forehead A and the blood flow B of the neck B. Next, the physical condition estimation unit 22 corrects the estimated level of stiff shoulders of the person 50 based on the degree of excitement of the person 50 estimated by the emotion estimation unit 24A.

Then, the output control unit 13A outputs the corrected stiff shoulder level to the display surface 62 of the mobile terminal 60 such as the smartphone of the person 50 as the output control according to the estimated physical condition of the person.

In the above-described embodiments and examples, it has been described that the estimated physical condition is corrected based on human emotions, but the present invention is not limited to this. The estimated person's emotions may be corrected based on the estimated person's physical condition. Hereinafter, the first modification and the second modification will be described.

(Modification example 1)
Hereinafter, as a modification 1, a case where the estimated physical condition is the sleep time of the previous day and the estimated emotion is the drowsiness level will be described.

FIG. 18 is a diagram showing an example of output control of the physical condition estimation device 20B in the first modification of the second embodiment.

In this modification, for example, the blood flow measuring unit 11B sets the blood flow at at least two sites as the blood flow A of the forehead A of the person 50, the blood flow B of the lower part B of the eyes of the person 50, and the nose of the person 50. The blood flow rate C of C is measured. First, the physical condition estimation unit 22 estimates the sleep time of the person 50 on the previous day as the physical condition of the person 50 based on the measured blood flow A of the forehead A and the blood flow B of the lower part B of the eye.

The emotion estimation unit 24B uses the emotions of the person 50 as the emotions of the person 50 based on the sleep time of the person 50 on the previous day estimated by the physical condition estimation unit 22 and the blood flow rate C of the nose C measured by the blood flow measurement unit 11B. Estimate drowsiness level. More specifically, since there is drowsiness when the skin temperature of the nose of a person rises, the emotion estimation unit 24B first estimates the drowsiness level (alertness) from the blood flow rate C measured by the blood flow measurement unit 11B. be able to. Next, the emotion estimation unit 24B determines the drowsiness level estimated from the blood flow rate C when the sleep time on the previous day of the person 50 estimated by the physical condition estimation unit 22 is short (for example, when it is shorter than the average sleep time of the person 50). It may be corrected to a deeper drowsiness level.

Then, as the output control, the output control unit 13B may output the corrected drowsiness level to the display surface 63 of the mobile terminal 60 such as the smart phone of the person 50 and display it.

In this way, the physical condition estimation device 20B may correct the estimated emotions based on the estimated physical condition.

The estimated physical condition is not limited to the sleep time of the previous day, but may be the degree of cold or hot weather. For example, when it is estimated that the person 50 feels cold as a physical condition, the drowsiness level estimated as the emotion of the person 50 may be corrected to a lower level. Further, the estimated physical condition is the presence or absence of "stiff shoulders", and the estimated emotion may be the pleasant emotion of the person 50. For example, when it is estimated that the person 50 has stiff shoulders as a physical condition, the pleasant emotion estimated as the emotion of the person 50 may be corrected to be lower than usual.

(Modification 2)
In the first modification, the case where the emotion of the person 50 is estimated from the blood flow in the nose of the person 50 has been described, but the present invention is not limited to this. As described above, the emotion of the person 50 may be estimated based on the face of the person 50 photographed by the camera unit 241. Hereinafter, this case will be described as a modification 2. In this variant, the estimated physical condition is the degree of cold and heat, and the estimated emotion is the drowsiness level.

FIG. 19 is a diagram showing an example of output control of the physical condition estimation device 20C in the second modification of the second embodiment.

In this modification, for example, the blood flow measuring unit 11 measures the blood flow A of the forehead A of the person 50 and the blood flow B of the lower part B of the eyes of the person 50 as the blood flow at at least two sites. First, the physical condition estimation unit 22 estimates the degree of cold and heat of the person 50 as the physical condition of the person 50 based on the measured blood flow A of the forehead A and the blood flow B of the lower part B of the eye.

The emotion estimation unit 24 determines the drowsiness of the person 50 as the emotion of the person 50 based on the degree of coldness of the person 50 estimated by the physical condition estimation unit 22 and the image of the entire face of the person 50 taken by the emotion estimation unit 24. Estimate the level.

More specifically, first, the emotion estimation unit 24 photographs the entire face of the person 50. Next, the emotion estimation unit 24 estimates the heart rate of the person 50 from the slight fluctuation of the complexion of the person 50, and determines the position on the axis of arousal drowsiness as shown in FIG. In addition, the emotion estimation unit 24 determines the position on the axis of comfort and discomfort from the facial expression estimated from the face of the photographed person 50. As a result, the emotion estimation unit 24 can estimate the drowsiness level as a person's emotion from the image of the entire face of the person 50 taken. Then, the emotion estimation unit 24 corrects the drowsiness level estimated from the image of the entire face of the person 50 based on the degree of cold and heat of the person 50 estimated by the physical condition estimation unit 22. For example, when the physical condition estimation unit 22 estimates that the person 50 feels cold as a physical condition, the emotion estimation unit 24 may make a correction to lower the drowsiness level estimated as the emotion of the person 50. ..

Then, as the output control, the output control unit 13C may output the corrected drowsiness level to the display surface 63C of the mobile terminal 60 such as the smart phone of the person 50 and display it.

In this way, the physical condition estimation device 20C may correct the estimated emotions based on the estimated physical condition.

Although the processing of the present invention has been described above in the first and second embodiments, the subject and the apparatus in which each processing is performed are not particularly limited.

For example, as described above, the physical condition estimation device may include a blood flow measurement unit, a physical condition estimation unit, an output control unit, and the like, but may also include only a physical condition estimation unit or only a physical condition estimation unit and an output control unit. Good. Further, the physical condition estimation unit and the output control unit may be processed by a cloud server or the like located at a location different from the local device. For example, heavy processing / control may be performed on the cloud server side, and light processing / control may be performed on the local device. For example, processing / control may be distributed between the cloud server device and the local device. The cloud server device and the local device may be collectively referred to as a physical condition estimation device.

It may also be processed by a processor or the like (described below) built into a particular device located locally.

(1) Specifically, the physical condition estimation device is a computer system including a microprocessor, a ROM, a RAM, a hard disk unit, a display unit, a keyboard, a mouse, and the like. A computer program is stored in the RAM or the hard disk unit. When the microprocessor operates according to the computer program, the physical condition estimation device achieves its function. Here, a computer program is configured by combining a plurality of instruction codes indicating instructions to a computer in order to achieve a predetermined function.

(2) A part or all of the components constituting the above-mentioned physical condition estimation device may be composed of one system LSI (Large Scale Integration).
A system LSI is an ultra-multifunctional LSI manufactured by integrating a plurality of components on a single chip, and specifically, is a computer system including a microprocessor, a ROM, a RAM, and the like. .. A computer program is stored in the RAM. When the microprocessor operates according to the computer program, the system LSI achieves its function.

(3) Some or all of the components constituting the above-mentioned physical condition estimation device may be composed of an IC card or a single module that can be attached to and detached from each device. The IC card or the module is a computer system composed of a microprocessor, a ROM, a RAM, and the like. The IC card or the module may include the above-mentioned super multifunctional LSI. When the microprocessor operates according to a computer program, the IC card or the module achieves its function. This IC card or this module may have tamper resistance.

(4) The present invention may be the method shown above. Further, it may be a computer program that realizes these methods by a computer, or it may be a digital signal composed of the computer program.

(5) Further, the present invention also relates to a recording medium capable of reading the computer program or the digital signal by a computer, for example, a flexible disk, a hard disk, a CD-ROM, an MO, a DVD, a DVD-ROM, a DVD-RAM, or a BD. It may be recorded on a Blu-ray (registered trademark) Disc), a semiconductor memory, or the like. Further, it may be the digital signal recorded on these recording media.

Further, the present invention may transmit the computer program or the digital signal via a telecommunication line, a wireless or wired communication line, a network typified by the Internet, data broadcasting, or the like.

Further, the present invention is a computer system including a microprocessor and a memory, in which the memory stores the computer program, and the microprocessor may operate according to the computer program.

Also, by recording and transferring the program or the digital signal on the recording medium, or by transferring the program or the digital signal via the network or the like, it is carried out by another independent computer system. You may do so.

(6) The above-described embodiment and the above-described modification may be combined.

(7) Further, the physical condition of the person may be other than those described in the first and second embodiments. For example, it may be an epileptic seizure, Meniere's disease, dizziness, or the like. In this case, in order to estimate the physical condition of a person, a physiological amount such as a person's blood flow may or may not be used. Hereinafter, a method for estimating the physical condition of a person other than those exemplified in the first and second embodiments will be described.

(Seizure)
As a person's physical condition, a method of estimating an epileptic seizure and an output when an epileptic seizure is estimated will be described.

The occurrence of epileptic seizures can be estimated (detected) from the human line of sight, respiration, and pupil diameter. This is because epileptic seizures are known to cause gaze stiffness, respiratory disturbances, and loss of pupillary light reflex. Therefore, epileptic seizures can be estimated (detected) as a person's physical condition by measuring the person's line of sight, respiration, and pupil diameter.

FIG. 20 is a flowchart showing an example of an epilepsy attack estimation and output control method.

As shown in FIG. 20, for example, a person's line of sight is detected (S31), and based on the detected person's line of sight, it is estimated whether or not the person has had an epileptic seizure (S32). Here, the occurrence of a person's epilepsy may be estimated by using all the information of the person's line of sight, respiration, and pupil, or even if one of them is used, a combination of a plurality of people may be used for epilepsy. The occurrence of seizures may be estimated.

Next, when it is estimated that no epileptic seizure has occurred (No in S32), the process returns to S31. On the other hand, if it is estimated that the person has had an epilepsy attack (Yes in S32), if the person is in a car, the device that controls the equipment such as the brake, accelerator, and active suspension of the car. A control signal is output (S33).

Further, if the person is in a self-driving car, he / she is automatically parked in a safe place or directly to the nearest hospital by self-driving (S34). In S34, the nearest ambulance or security center may be called.

(Ménière's disease and dizziness)
Next, a method of estimating Meniere's disease or dizziness as a person's physical condition and an output when estimating Meniere's disease or dizziness will be described.

By detecting a person's line of sight, Meniere's disease or dizziness of the person can be estimated (detected). This is because it is known that people's eyes are spinning when dizziness or Meniere's disease occurs.

Then, when a person's Meniere's disease or dizziness is estimated (detected), if the person is in a self-driving car, the brake, accelerator, and active of the car are automatically parked in a safe place. You may control or direct equipment such as suspensions. Of course, you may call the nearest ambulance or security center immediately, or you may control the nearest hospital to drive directly.

(Various diseases)
In addition, the following diseases may be estimated (detected) as a person's physical condition from the following components and secretions contained in exhaled breath.

For example, when the amount of ammonia contained in the exhaled breath is large, it is possible to detect a decrease in renal function and liver function of the person, deterioration of the intestinal environment, and gout. In addition, for example, when the amount of NO contained in exhaled breath is large, bronchial asthma or drowsiness of the person can be detected. Further, for example, when the secretion of hydrogen sulfide contained in the exhaled breath is large, the gastrointestinal disease of the person concerned can be detected. Further, for example, when the secretion of 3-methyl-3-sulfanylhexane-1-ol contained in the exhaled breath is large, it can be estimated that the person is under mental stress.

Then, for example, a sensor capable of detecting each of the above-mentioned chemical substances may be placed on the desk or mouse of the person's office, and the person or the medical department may be notified when the above-mentioned physical condition of the person is detected. Thereby, prevention against various diseases of the person concerned can be promoted.

(Deep body temperature)
In addition, the core body temperature may be estimated as a person's physical condition.

By detecting the body surface temperature of the person, the core body temperature can be estimated. For example, the forehead temperature is said to be close to the core body temperature, and the core body temperature can be estimated by detecting the forehead temperature and the like with a thermo camera. Further, by measuring the room temperature at the same time and correcting the body surface temperature, the core body temperature can be estimated more accurately. The core body temperature may be estimated with higher accuracy by estimating the core body temperature including the temperature of other parts such as the eyeball.

Hereinafter, an example of output control when the core body temperature is estimated (detected) will be described.

FIG. 21 is a diagram for explaining one aspect of output control depending on the detection result of core body temperature. FIG. 22 is a flowchart showing an example of an output control method depending on the detection result of core body temperature.

By detecting the forehead temperature and the like of the patient 51 with the thermo camera 40 as shown in FIG. 21, the core body temperature of the patient 51 who visited the hospital can be measured in a non-contact manner. Therefore, for example, the fever state of the patient 51 can be detected by detecting the core body temperature of the patient 51 before entering the hospital, so that the entrance to the hospital (waiting room) may be automatically opened according to the fever state.

That is, as shown in FIG. 22, first, the core body temperature of the patient 51 is detected by the thermo camera 40 (S41), and the core body temperature of the patient 51 is 38 ° C. or higher, 37 ° C. to 38 ° C., or 37 ° C. or lower. It is determined whether or not there is (S42).

In S42, if the core body temperature of the patient 51 is, for example, 38 ° C. or higher, the door A of the waiting room A is automatically opened (S43), and if the core body temperature of the patient 51 is 37 ° C. to 38 ° C., the waiting room B is controlled. The door B is automatically opened (S44). If the core body temperature of the patient 51 is 37 ° C. or lower, control is performed to automatically open the door C of the waiting room C (S45).

As a result, the patient 51 who has a high fever does not have to wait in the same room as the patient 51 who has a normal fever, so that the patient who has a normal fever can be prevented from being infected by the patient who has a high fever.

Further, the threshold value of the core body temperature shown in FIGS. 21 and 22 may be another value, or may be adjusted according to the age. This is because it is known that younger people have higher body temperature. For example, the age may be registered in a medical examination ticket or the like, and can be realized by holding the medical examination ticket in which the age or the like is stored at the same time as the thermo camera 40 over the reader.

In addition, this estimation method may be installed in a taxi. As a result, it is possible to refuse the ride of the fever patient as needed, so that it is possible to prevent a secondary infection to the driver. In addition, when boarding public transportation such as a train, a person with a high body temperature and a person with a normal temperature may ride separately. This is because the spread of illness in transportation such as trains can be reduced.

Further, the method of estimating the core body temperature and the example of its output control are not limited to these.

For example, the core body temperature at the time of waking up may be measured (estimated) on a daily basis, and the menstrual cycle of a woman can be estimated. Then, in the estimated menstrual cycle, when it is easy to dry, the settings of the humidifier, the air conditioner, and the like may be automatically adjusted to control the skin to be difficult to dry. If it is a time when it is easy to get irritated, you may control to select a song that you can relax in stereo or the like.

The timing of daily measurement of core body temperature is not limited to the time of waking up, as long as it can be measured under the same conditions every day, for example, when washing the face in the morning.

Further, for example, the core body temperature may be measured when commuting to an office or the like. For example, by measuring the core body temperature at the moment of holding the card reader at the time of admission, it is possible to connect a person with the core body temperature, so that an employee with a fever can be identified. Then, for example, the boss who obtained the fever information of his subordinates can adjust the work balance and encourage him to return home to maintain the health of the employee and prevent the transmission to other employees.

(Dry skin)
In addition, the dryness level of the skin may be estimated as a person's physical condition.

This is because the dryness level of the skin can be estimated by measuring the water content of the person's skin. Then, in the case of a predetermined dry level, that is, when the water content of the skin is lowered to a predetermined value or less, the humidifier in the room where the person is present may be operated to control the humidity in the room. Thereby, the beauty effect of the person concerned can be promoted.

(Metabolism amount)
In addition, the amount of metabolism may be estimated as a person's physical condition.

By measuring the temperature of the clavicle portion of the person with a thermo camera, a radiation thermometer, or the like, the metabolic rate of the person can be estimated. It is known that the presence of brown fat increases the amount of metabolism, brown fat is localized in the clavicle part, and brown fat produces heat. Therefore, the amount of metabolism can be estimated by measuring the temperature of the clavicle portion of the person concerned.

Then, for example, if the amount of metabolism is estimated and the calorie intake is larger than the estimated amount of metabolism, a warning may be given to the person concerned. This makes it possible to prevent obesity and the like of the person concerned.

(Other)
Further, as a person's physical condition, how to sit on a chair may be estimated (detected).

By arranging a sensor that measures the pressure distribution on the seated portion of the chair, it is possible to detect how the person sits on the chair. Then, the back pain may be prevented by estimating the portion prone to low back pain from the detected sitting style of the person and warming the portion with a heater.

In addition, shortness of breath may be estimated (detected) as a person's physical condition.

Shortness of breath can be detected from the respiratory rate and oxygen saturation of the person. When shortness of breath is detected, the rhythm of breathing may be notified by voice or the like. As a result, the breathing rhythm of the person can be adjusted. As for the respiratory rhythm, the person's breathing can be adjusted by notifying the detected rhythm that is slightly slower than the current respiratory rate of the person and gradually slowing the notified rhythm.

Further, as a person's physical condition, palpitation due to tension or the like may be estimated (detected) by measuring the heart rate.

Then, when it is detected that palpitation is caused by tension or the like, the person may be informed of a sound having a rhythm slightly slower than the measured current heart rate. As a result, the heart rate of the person concerned can be lowered and the tension can be released. If a certain amount of tension is required before a sports game, the sound of a rhythm that is gradually faster than the heartbeat at rest may be heard. This can lead to an ideal tension state.

The premium for life insurance or medical insurance may be adjusted according to the type and degree of physical condition detected and the time. As a result, it is possible to reduce the stakes of a person who is in good physical condition and increase the stakes of a person who is in poor physical condition, so that the insured person can be more convinced.

In addition, when a person who is in poor physical condition is detected in a movie theater or the like, the person in charge may be notified so that, for example, the person in charge who has received the notification may call out to the person to urge him / her to leave. As a result, it is possible to prevent the screening from being interrupted by a person who is in poor physical condition.

As described above, the method of estimating the physical condition of a person other than those exemplified in the first and second embodiments has been described, but the present invention is not limited to this. Similarly, human emotions may be estimated by a method other than that described in the second embodiment. Hereinafter, for example, an example will be described.

(Frustrated level)
For example, the frustration level may be estimated (detected) as a person's emotion.

The frustration level can be estimated from the facial expression and blood flow of the person. This is because it is known that people appear in facial expressions when they are frustrated. In addition, it is known that when a person is irritated, the sympathetic nerve is increased and the peripheral blood flow is reduced, so that the peripheral blood flow is reduced. Here, the frustration level of a person may be estimated by using all the information of facial expression and blood flow, or the frustration level may be estimated by using any one of them or a combination of a plurality of them. I do not care.

Then, when the frustration level of the person is estimated, if the person is driving, the engine sound of the car may be controlled to be taken into the car more, and the sense of speed may be amplified more than the actual speed. This makes it possible to prevent the person concerned from overspeeding. Of course, when a person's frustration is estimated, a control that lowers the sensitivity of the accelerator of the vehicle may be performed to prevent a sudden start, or a control that lowers the sensitivity of the brake may be performed to prevent a sudden stop.

(Drowsiness level)
Further, for example, the drowsiness level may be estimated (detected) as a human emotion.

This is because it is known that when a person feels drowsy, he / she appears in his / her facial expression. In addition, when a person feels drowsy, the parasympathetic nerves increase and the variation in heartbeat interval increases, the blood pressure in the peripheral part increases, and the skin temperature in the peripheral part rises accordingly. This is because it is known that dilation lowers blood pressure. It is also known that when the breathing interval is shortened, the oxygen concentration decreases and the patient feels drowsy.

Thus, the drowsiness level of a person may be estimated from the facial expression, heartbeat interval, respiration, blood pressure, blood flow or skin temperature of the person.

Here, the sleepiness level of a person may be estimated by using all the information of a person's facial expression, heartbeat interval, respiration, blood pressure, blood flow, and skin temperature, or even if any one of them is used, a plurality of them may be used. The drowsiness level may be estimated using a combination of.

Further, the combination of the information with the highest estimation accuracy may be learned and the combination may be changed for each person.

For example, it is known that some people tend to get drowsiness on their faces, while others do not. For people who tend to get drowsiness on their faces, it is sufficient to estimate by facial expression, and of course, it is possible to estimate the drowsiness level with high accuracy by detecting it in combination with facial expression and other physiological quantities. Similarly, the combination may be changed according to the drowsiness level to be detected. Also, for example, some people have a marked drop in blood pressure during early onset of drowsiness, while others do not. Therefore, when detecting early drowsiness, a person whose blood pressure drops remarkably when early drowsiness occurs may estimate drowsiness including blood pressure.

It should be noted that these are examples, and drowsiness may be estimated by including other physiological indexes as needed. As a result, highly accurate drowsiness estimation can be realized. That is, the same applies not only to the estimation of early drowsiness but also to the estimation of deep drowsiness, and any physiological index may be selected. This makes it possible to estimate the drowsiness level with high accuracy by selecting the optimum physiological index by learning according to the person and the depth of drowsiness to be detected.

Then, when drowsiness is detected (estimated), if the person is driving, the vehicle may be controlled to take in outside air so as to ventilate the vehicle and increase the oxygen concentration in the vehicle. By doing so, the drowsiness of the person can be reduced. It should be noted that, for example, by opening the partition between the engine room and the vehicle interior so as to capture the engine sound of the vehicle more into the vehicle, the sense of speed may be amplified and the arousal level may be increased. Further, the arousal level may be increased by controlling the hardness of the suspension of the vehicle and transmitting the vibration.

(Detection method for each physiological amount)
Hereinafter, a method for detecting each physiological amount will be illustrated.

(Heart rate)
The heart rate can be detected by detecting subtle color fluctuations in the flesh-colored part of the face taken by the camera. This is because the green component of the skin color of the face fluctuates in synchronization with the heartbeat.

Further, the heart rate may be detected by detecting the temperature fluctuation in the temperature range corresponding to the skin of the face photographed by the thermo camera. This is because the temperature of the face taken by the thermo camera fluctuates in synchronization with the heart rate cycle, so that the heart rate can be known by detecting the temperature fluctuation in the temperature range corresponding to the skin.

Alternatively, the earlobe, fingers, and the like may be irradiated with infrared rays, and the heart rate may be detected from the amount of fluctuation of the reflected infrared rays. Further, the vibration generated by the heartbeat may be detected by a seat sensor or the like, and the heartbeat waveform may be obtained to detect the heartbeat, regardless of the method.

(blood pressure)
Blood pressure can be determined from the pulse wave velocity. The pulse wave velocity is the time it takes for the blood flow from the heart to reach a predetermined end.

When the blood pressure decreases, the pulse wave velocity tends to be long, and when the blood pressure rises, the pulse wave velocity tends to be long. The pulse wave propagation time can be obtained from the amount of time difference between the pulse wave peak obtained from the face image taken by the camera and the pulse wave peak time obtained from the image obtained from the image other than the face (neck, hand, etc.). .. The pulse wave velocity may be obtained from the amount of deviation of the peak time of the pulse wave at two different places (for example, the chin and the forehead) in the face, for example, other than the face and the face.

In addition, the vibration of the heart is obtained by a millimeter wave sensor or the like, the pulse wave of the face is detected from the subtle color fluctuation of the face image taken by the camera, and the time difference between the vibration peak of the heart and the pulse wave peak of the face is the pulse wave. Blood pressure may be obtained by estimating blood pressure fluctuation as the propagation time.

(Skin moisture)
Skin moisture can be measured by irradiating the skin with a near-infrared water absorption wavelength (960 nm) and detecting the amount of returning light. This is because when the skin has a lot of moisture, the irradiated near-infrared light is absorbed and the amount of returned near-infrared light decreases.

In addition, the amount of water (skin moisture) may be estimated from the hardness of the skin by irradiating ultrasonic waves or air and detecting the amount of fluctuation at that time with millimeter waves or the like. This is because humans know that when the skin's moisture decreases, the skin becomes stiff.

(Blood glucose level)
The blood glucose level can be determined by detecting the returning component of the infrared light irradiated to the eyeball. This is because, in the spectrum of the eyeball portion (aqueous humor), since the absorption wavelength of sugar (around 1650 nm) is absorbed, the proportion of infrared light returned decreases as the blood glucose level increases.

In addition, the blood glucose level may be estimated from the optical rotation of the eyeball portion (aqueous humor). This is because the higher the blood glucose level, the greater the optical rotation. Of course, the method for estimating the blood glucose level may be another method, and the method is not limited.

(Exhaled component)
The exhaled breath component can be detected from the absorption amount of the absorption wavelength of the component to be detected (for example, around 225 nm in the case of NO) among the components contained in the exhaled breath.

For example, the exhaled component can be detected by irradiating the exhaled light with the light of the component to be detected and detecting the amount of transmitted light. Of course, the spectrum may be detected by chromatography or the like, and the method is not limited.

(Breathing)
Respiration can be detected by irradiating a person who wants to measure respiration with, for example, a rectangular pattern with infrared rays or the like in a camera image and detecting the respiration waveform from the fluctuation of the pattern.

Respiration may be detected using visible light instead of infrared rays, and the irradiation pattern may not be a rectangular pattern. Further, it may be detected by irradiating a millimeter wave and detecting it from the amount of Doppler shift of the reflected wave, or it may be detected by using a TOF sensor.

Further, it is known that the temperature of the lower part of the nostril fluctuates due to respiration, for example, the temperature of the lower part of the nostril decreases during inspiration and the temperature of the lower part of the nostril rises during exhalation. Therefore, the respiratory waveform may be detected from the temperature fluctuation of the nostril portion by using the thermal image.

INDUSTRIAL APPLICABILITY The present invention can be used for a physical condition estimation method for estimating a person's physical condition, a physical condition estimation device, and a program, and in particular, a physical condition mounted on an application of a device for controlling these such as a vehicle, an office, a living space device, and the like. It can be used for estimation methods, physical condition estimation devices, and programs.

10, 20, 20A, 20B, 20C Physical condition estimation device 11, 11A, 11B Blood flow measurement unit 12, 22 Physical condition estimation unit 13, 13A, 13B, 13C Output control unit 24, 24A, 24B Emotion estimation unit 40 Thermocamera 50 people 51 Patient 60 Mobile terminal 61, 62, 63, 63C Display surface 70 Car navigation screen 71 Public toilet 72 Parking area 111, 241 Camera unit 112 Blood flow measurement processing unit 121 Blood flow acquisition unit 122 Physical condition estimation processing unit 223 Estimated emotion acquisition unit 224 Correction unit 242 Facial expression estimation unit 243 Emotion estimation processing unit 244 Memory unit

Claims (24)

It is a physical condition estimation device
The menstrual period acquisition department that acquires a person's menstrual period,
Based on the acquired physiological quantity, a physical condition indicating a mental and physical condition other than the mental state of the person defined in a predetermined model used for estimating emotions of the person is estimated, and the estimated physical condition is expressed. The physical condition estimation processing unit that generates the first physical condition information,
Said at the time you get a physiological quantity, the person of, obtaining first emotion information representing emotions of indicating the state of mind of a person to be defined in the predetermined model estimating emotion acquisition unit,
(1) Generate the second physical condition information obtained by correcting the first physical condition information based on the first emotion information and output the second physical condition information, or (2) based on the first physical condition information. wherein the first emotion information to generate a second emotion information corrected, e Bei and a correction unit for outputting a second emotion information,
The first emotional information uses a value indicating the degree of comfort and discomfort determined based on the facial expression of the person and a value indicating the degree of arousal drowsiness determined based on the physiological data of the person as the predetermined model. Estimated by applying,
Physical condition estimation device. further,
A physiological quantity measuring unit for measuring the physiological quantity of the person is provided.
The physical condition estimation device according to claim 1. further,
An emotion estimation unit that estimates the emotion of the person based on a physiological amount different from the physiological amount used when estimating the physical condition of the person and generates the first emotion information representing the estimated emotion. Prepare, prepare
The physical condition estimation device according to claim 1 or 2. further,
It is provided with an output control unit that performs output control according to the second physical condition information or the second emotion information.
The physical condition estimation device according to any one of claims 1 to 3. The physiological amount acquisition unit acquires the blood flow rate at each of the first part where the blood flow rate does not fluctuate according to the physical condition of the person and the second part where the blood flow rate fluctuates according to the physical condition of the person.
The physical condition estimation device according to any one of claims 1 to 4. The first site is at least one of the person's forehead, oral cavity, and eyeball, and the second site is at least one of the person's lower eye, nose, lips, limbs, and neck. ,
The physical condition estimation device according to claim 5. Based on the blood flow in the first part and the second part, the physical condition estimation processing unit determines the physical condition of the person such as sleep time, degree of cold and heat, stiff shoulders, headache, level of wanting to go to the toilet, motion sickness level, and alcohol. Estimate at least one of motion sickness level, driving skill, hunger level, fatigue level (stress), and depression level,
The physical condition estimation device according to claim 5 or 6. The physiological amount acquisition unit includes heart rate, heartbeat interval, blood pressure, facial expression, exhaled breath information, blood glucose level, abdominal sound, oxygen saturation and lactic acid concentration in bloodstream, line of sight, respiration, And get at least one of the pupil diameters,
The physical condition estimation device according to any one of claims 1 to 4. Based on the acquired physiological amount, the physical condition estimation processing unit has a level of wanting to go to the toilet, a motion sickness level, a drunkenness level, a driving skill, a hunger level, a fatigue level (stress), a depression level, a seizure, and Meniere's disease. , And estimate at least one of the dizziness,
The physical condition estimation device according to claim 8. The emotion estimation unit, as the physiological quantity, includes the person's face color, heart rate, heart rate fluctuation, LF / HF (Low Frequency / High Frequency) of heart rate fluctuation, RR interval, pulse wave, and pulse fluctuation. , Brain wave, respiratory rate, respiratory rate, blood flow, blood flow fluctuation, blood pressure, blood pressure fluctuation, oxygen saturation (SpO2), body part movement, blink frequency and speed, body muscle movement, facial muscle Based on at least one of movement, body temperature, skin temperature, skin conductance, skin resistance, skin roughness, skin shine, sweating rate and sweating rate, the person's emotions include drowsiness level, irritability level, and pleasant feeling. Estimate at least one,
The physical condition estimation device according to claim 3. The physical condition estimation processing unit estimates the degree of sleep time or cold heat as the physical condition of the person based on the physiological amount of the person.
The emotion estimation unit estimates the drowsiness level as the emotion of the person based on a type of physiological amount different from the physiological amount used when estimating the physical condition of the person.
The correction unit corrects the estimated drowsiness level based on the estimated sleep time or the degree of cold heat of the person.
The physical condition estimation device according to claim 3. The physiological quantity measuring unit includes a camera unit and a blood flow rate measuring processing unit.
The camera unit irradiates at least two places with light having a predetermined wavelength to receive light having different wavelengths.
The blood flow measurement processing unit measures the blood flow rate at at least two locations based on the light of different wavelengths received by the camera unit.
The physical condition estimation device according to claim 2. The physiological quantity measuring unit includes a camera unit and a thermal image acquisition unit.
The physical condition estimation device further
(1) The facial expression of the person is estimated based on the face of the person photographed by the camera unit, and (2) at least a part of the thermal image of the face of the person photographed by the thermal image acquisition unit. It is provided with an emotion estimation unit that estimates the person's physiological amount based on the region of (3) and estimates the person's emotion based on the facial expression and the physiological amount.
The physical condition estimation device according to claim 2. The output control unit performs at least one of display control, notification control, and device control as the output control in response to the second physical condition information or the second emotion information.
The physical condition estimation device according to claim 4. The output control unit, as at least one of the display control, the notification control, and the device control, (1) notifies an in-vehicle device or the person's mobile terminal of predetermined information, and (2) brightness of the lighting device. Controls the air volume, temperature, and direction of the air conditioner, (4) controls the acoustic equipment to play a predetermined music, (5) brakes, accelerators, and actives of the car. Outputs a device control signal that controls either the suspension or the engine.
The physical condition estimation device according to claim 14. When estimating the drowsiness level as the emotion of the person, the emotion estimation unit determines the drowsiness level to be detected, and a combination of a predetermined physiological amount from a plurality of physiological amounts according to the determined drowsiness level. Select and
Estimate the drowsiness level using a combination of selected physiological doses,
The physical condition estimation device according to claim 10. When estimating the drowsiness level as the emotion of the person, the emotion estimation unit determines a person who should detect the drowsiness level.
A combination of predetermined physiological amounts is selected from a plurality of physiological amounts according to the determined person.
Estimate the drowsiness level using a combination of selected physiological doses,
The physical condition estimation device according to claim 10. The emotion estimation unit learns the combination of physiological amounts used for estimating the drowsiness level for each drowsiness level to be detected.
When estimating the drowsiness level as the emotion of the person, the optimum combination of physiological amounts is selected according to the drowsiness level to be detected based on the learning result.
The physical condition estimation device according to claim 10. The emotion estimation unit learns the combination of physiological amounts used for estimating the drowsiness level for each person whose drowsiness level should be detected.
When estimating the drowsiness level as the emotion of the person, the optimum combination of physiological amounts is selected according to the person to detect the drowsiness level based on the learning result.
The physical condition estimation device according to claim 10. It is a physical condition estimation system
A physiological amount measuring device that measures a person's physiological amount,
Equipped with a physical condition estimation device
The physical condition estimation device is
A physiological amount acquisition unit that acquires the physiological amount of the person from the physiological amount measuring device,
Based on the acquired physiological quantity, a physical condition indicating a mental and physical condition other than the mental state of the person defined in a predetermined model used for estimating emotions of the person is estimated, and the estimated physical condition is expressed. The physical condition estimation processing unit that generates the first physical condition information,
Said at the time you get a physiological quantity, the person of, obtaining first emotion information representing emotions of indicating the state of mind of a person to be defined in the predetermined model estimating emotion acquisition unit,
(1) Generate the second physical condition information obtained by correcting the first physical condition information based on the first emotion information and output the second physical condition information, or (2) based on the first physical condition information. wherein the first emotion information to generate a second emotion information corrected, e Bei and a correction unit for outputting the second emotion information,
The first emotional information uses a value indicating the degree of comfort and discomfort determined based on the facial expression of the person and a value indicating the degree of arousal drowsiness determined based on the physiological data of the person as the predetermined model. Estimated by applying,
Physical condition estimation system. The physical condition estimation device further
An emotion estimation unit that estimates the emotion of the person based on a physiological amount different from the physiological amount used when estimating the physical condition of the person and generates the first emotion information representing the estimated emotion. Prepare, prepare
The physical condition estimation system according to claim 20. The physical condition estimation device further
It is provided with an output control unit that performs output control according to the second physical condition information or the second emotion information.
The physical condition estimation system according to claim 20 or 21. It ’s a processor,
Physiological amount acquisition process to acquire human physiological amount and
Based on the acquired physiological quantity, a physical condition indicating a mental and physical condition other than the mental state of the person defined in a predetermined model used for estimating emotions of the person is estimated, and the estimated physical condition is expressed. The physical condition estimation process that generates the first physical condition information, and
At the time of acquiring the physiological amount, and the Personality, obtaining first emotion information representing emotions indicating the state of the human heart, which is defined in the predetermined model estimation emotion acquisition process,
(1) Generate the second physical condition information obtained by correcting the first physical condition information based on the first emotion information and output the second physical condition information, or (2) based on the first physical condition information. The correction process of generating the second emotion information obtained by correcting the first emotion information and outputting the second emotion information is executed .
The first emotional information uses a value indicating the degree of comfort and discomfort determined based on the facial expression of the person and a value indicating the degree of arousal drowsiness determined based on the physiological data of the person as the predetermined model. Estimated by applying,
Processor. A physical condition estimation device including a physiological quantity measuring unit for measuring a human physiological quantity and the processor according to claim 23.

Images