WO2024042613A1

WO2024042613A1 - Terminal, method for controlling terminal, and storage medium

Info

Publication number: WO2024042613A1
Application number: PCT/JP2022/031726
Authority: WO
Inventors: 瑛里子今井
Original assignee: 日本電気株式会社
Priority date: 2022-08-23
Filing date: 2022-08-23
Publication date: 2024-02-29

Abstract

Provided is a terminal that contributes to more reliably preventing recurrence of a disease. This terminal comprises an acquisition means, an estimation means, a calculation means, and a provision means. The acquisition means acquires biometric information pertaining to a user. The estimation means estimates vital data on the basis of the acquired biological information. The calculation means calculates a disease recurrence risk value indicating a risk of disease recurrence in the user on the basis of the estimated vital data. The provision means provides information that corresponds to the calculated disease recurrence risk value.

Description

Terminal, terminal control method, and storage medium

The present invention relates to a terminal, a terminal control method, and a storage medium.

Technology exists to warn users of disease recurrence.

For example, Patent Document 1 describes that a device is provided that can automatically record the weight of a person who has experienced heart failure or renal failure and can notify a warning when the possibility of disease recurrence increases. .

Additionally, there is a technology that estimates a user's weight based on a facial image.

For example, Patent Document 2 describes that it is possible to analyze multiple facial images and measure body weight based on the correlation between parts that influence body weight and parts that do not.

Japanese Patent Application Publication No. 2015-164502 JP 2017-041218 Publication

As described in Patent Document 1, there is a relationship between the onset of heart failure and weight gain. However, in order to prevent recurrence of diseases such as heart failure, it is necessary to understand not only weight but also other vital data (e.g., blood pressure, heart rate) and the patient's subjective symptoms (e.g., swelling, shortness of breath, etc.) becomes.

That is, as disclosed in Patent Document 1, simply observing changes in body weight may not be sufficient to prevent disease recurrence. Note that Patent Document 2 only discloses that body weight is measured by analyzing facial images, and has nothing to do with preventing disease recurrence.

The main purpose of the present invention is to provide a terminal, a terminal control method, and a storage medium that contribute to more reliably preventing disease recurrence.

According to a first aspect of the present invention, there is provided an acquisition means for acquiring biological information of a user, an estimation means for estimating vital data based on the acquired biological information, and an estimation means for estimating vital data based on the acquired biological information; A terminal is provided, comprising a calculation means for calculating a disease recurrence risk value indicating the disease recurrence risk of the user based on the above information, and a providing means for providing information according to the calculated disease recurrence risk value. Ru.

According to the second aspect of the present invention, a terminal acquires biometric information of a user, estimates vital data based on the acquired biometric information, and estimates the vital data of the user based on the estimated vital data. A method for controlling a terminal is provided, which calculates a disease recurrence risk value indicating a disease recurrence risk and provides information according to the calculated disease recurrence risk value.

According to the third aspect of the present invention, a computer installed in a terminal is provided with a process of acquiring biometric information of a user, a process of estimating vital data based on the acquired biometric information, and a process of estimating vital data based on the acquired biometric information. A program for executing a process of calculating a disease recurrence risk value indicating the risk of disease recurrence of the user based on the vital data obtained by the user, and a process of providing information according to the calculated disease recurrence risk value. A computer-readable storage medium is provided for storing.

According to each aspect of the present invention, a terminal, a terminal control method, and a storage medium are provided that contribute to more reliably preventing disease recurrence. Note that the effects of the present invention are not limited to the above. According to the present invention, other effects may be achieved instead of or in addition to the above effects.

FIG. 1 is a diagram for explaining an overview of one embodiment. FIG. 2 is a flowchart for explaining the operation of one embodiment. FIG. 3 is a diagram illustrating an example of a schematic configuration of an information processing system according to the first embodiment. FIG. 4 is a diagram illustrating an example of a processing configuration of a user terminal according to the first embodiment. FIG. 5 is a diagram illustrating an example of a display on a user terminal according to the first embodiment. FIG. 6 is a diagram illustrating an example of the health management database according to the first embodiment. FIG. 7 is a diagram showing an example of a display on a user terminal according to the first embodiment. FIG. 8 is a diagram for explaining the operation of the health information providing unit according to the first embodiment. FIG. 9 is a diagram illustrating an example of a display on the supporter terminal according to the first embodiment. FIG. 10 is a flowchart illustrating an example of the operation of the user terminal according to the first embodiment. FIG. 11 is a diagram illustrating an example of the hardware configuration of a user terminal according to the present disclosure.

First, an overview of one embodiment will be explained. Note that the drawing reference numerals added to this summary are added to each element for convenience as an example to aid understanding, and the description of this summary is not intended to be limiting in any way. Furthermore, unless otherwise specified, the blocks depicted in each drawing represent the configuration of functional units rather than the configuration of hardware units. Connection lines between blocks in each figure include both bidirectional and unidirectional connections. The unidirectional arrows schematically indicate the main signal (data) flow, and do not exclude bidirectionality. Note that, in this specification and the drawings, elements that can be explained in the same manner may be designated by the same reference numerals, so that redundant explanation can be omitted.

The terminal 100 according to one embodiment includes an acquisition means 101, an estimation means 102, a calculation means 103, and a provision means 104 (see FIG. 1). The acquisition means 101 acquires the user's biometric information (step S1 in FIG. 2). The estimation means 102 estimates vital data based on the acquired biological information (step S2). The calculation means 103 calculates a disease recurrence risk value indicating the user's disease recurrence risk based on the estimated vital data (step S3). The providing means 104 provides information according to the calculated disease recurrence risk value (step S4).

The terminal 100 acquires biometric information of a user (user at risk of disease recurrence) and estimates vital data based on the acquired biometric information. For example, the terminal 100 estimates vital data such as the user's weight, blood pressure, and heart rate from biometric information. The terminal 100 calculates the user's disease recurrence risk value using the estimated vital data, and provides information according to the calculated risk value. For example, if it is determined that the risk (possibility) of disease recurrence is high, the terminal 100 notifies the user or his or her supporter to that effect. That is, the terminal 100 calculates a disease recurrence risk value using not only the weight but also other vital data, and provides appropriate information to the patient or his or her supporter based on the risk value. As a result, an accurate risk of disease recurrence is calculated, and with appropriate support from supporters, disease recurrence can be more reliably prevented.

Specific embodiments will be described in more detail below with reference to the drawings.

[First embodiment]
The first embodiment will be described in more detail using the drawings.

[System overview]
FIG. 3 is a diagram illustrating an example of a schematic configuration of an information processing system (information providing system) according to the first embodiment. As shown in FIG. 3, the information processing system includes a user and a supporter.

In the present disclosure, patients who are at risk of disease recurrence are assumed to be the main users. For example, a patient suffering from heart failure is assumed to be a user. A user has a user terminal 10 such as a smartphone. A user inputs various information into the user terminal 10 or obtains information from the user terminal 10.

Supporters support the daily lives of users with chronic illnesses. For example, a family doctor, a family member, a relative, an acquaintance, a friend, a care staff member, a welfare officer, etc. are exemplified as supporters. The supporter has a supporter terminal 20 such as a smartphone. The supporter inputs various information into the supporter terminal 20 or obtains information from the supporter terminal 20.

Users who are at risk of disease recurrence enter information regarding their daily health into an application installed on the user terminal 10. For example, a patient suffering from heart failure uses a "health management application" to input "questionnaire information" in order to prevent recurrence of heart failure.

The medical interview information is information necessary for a doctor to determine whether or not the user's illness will recur. For example, the interview information includes "medication information," "subjective symptoms," "hospital visit records," "sleep information," "meal information," "exercise information," and the like.

A "health notebook (heart failure notebook)" is created by the user inputting medical interview information into the user terminal 10 every day.

Additionally, the user terminal 10 acquires the user's biometric information and estimates the user's vital data from the acquired biometric information. The user terminal 10 calculates the user's disease recurrence risk using the estimated value of vital data, and provides the user and/or the supporter with information corresponding to the disease recurrence risk.

[User terminal]
FIG. 4 is a diagram showing an example of a processing configuration (processing module) of the user terminal 10 according to the first embodiment. Referring to FIG. 4, the user terminal 10 includes a communication control section 201, an identity confirmation section 202, an interview information control section 203, a recurrence risk management section 204, a health information provision section 205, a storage section 206, Equipped with

The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the supporter terminal 20. Furthermore, the communication control unit 201 transmits data to the supporter terminal 20. The communication control unit 201 passes data received from other devices to other processing modules. The communication control unit 201 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 201. The communication control unit 201 has a function as a reception unit that receives data from another device, and a function as a transmission unit that transmits data to the other device.

Among the processing modules that make up the user terminal 10, the "health management application" is mainly realized by the identity verification section 202, medical interview information control section 203, recurrence risk management section 204, and health information provision section 205.

The identity verification unit 202 is a means for verifying the identity of the user who operates the user terminal 10. The identity verification unit 202 verifies the user's identity before the user inputs medical interview information. That is, the identity verification unit 202 prevents a third party other than the individual from inputting medical interview information into the health management application.

The user terminal 10 stores the owner's biometric information (for example, face information, fingerprint information). When a user performs an action to start a health management application (for example, by clicking a corresponding icon), the identity verification unit 202 acquires biometric information (for example, facial information, fingerprint information) for authenticating the user. do.

The identity verification unit 202 determines that identity verification has been successful if the biometric information registered in advance and the biometric information acquired at the time of starting the health management application substantially match. If the identity verification section 202 fails to verify the identity, the identity verification section 202 cancels activation of the health management application. If the identity verification is successful, the identity verification unit 202 completes activation of the health management application.

Note that the identity verification using biometric information is obvious to those skilled in the art, so a detailed explanation will be omitted. For example, the identity verification unit 202 calculates the degree of similarity between feature amounts generated from facial images. If the degree of similarity is greater than or equal to the predetermined value, the identity verification unit 202 determines that identity verification has been successful.

Note that the identity verification unit 202 may perform identity verification using other information instead of or in addition to biometric information. For example, the identity verification unit 202 may perform identity verification (identity authentication) using a password or the like.

The medical interview information control unit 203 is a means for controlling the medical interview information acquired from the user. The medical interview information control unit 203 functions as an acquiring unit (obtaining means) that acquires biometric information and medical interview information of the user, and an estimating unit (estimating unit) that estimates vital data based on the acquired biological information. It has the functions of:

When the user's identity is successfully verified and the user performs a predetermined operation on the health management application (for example, pressing the input button for the health notebook), the medical interview information control unit 203 creates a graphical user interface (GUI) for acquiring medical interview information. Display the interface). For example, the medical interview information control unit 203 acquires medical interview information using a GUI as shown in FIG.

In the example of FIG. 5, the presence or absence of "shortness of breath," "swelling," "easiness to get tired," "decreased appetite," and "insomnia" are acquired as subjective symptoms. Furthermore, whether or not exercise is performed is acquired as exercise information. Furthermore, as medication information, whether or not medication is taken during each time period of morning, noon, and evening is acquired. Note that the display shown in FIG. 5 is an example, and is not intended to limit the items to be displayed or the display mode. For example, the medical interview information control unit 203 may automatically indicate and record the date and time (year, month, day, hour, minute, and second) when the user inputs the health notebook. Alternatively, considering that the users are often elderly, the medical interview information control unit 203 may prepare an interface that allows users to enter each item on a large screen, rather than an interface that allows them to enter all items on one screen. Good too. Alternatively, the medical interview information control unit 203 may support not only information input using a touch panel but also information input using voice. Alternatively, the medical interview information control unit 203 may automatically capture input data from other wearable terminals or health applications, and automatically display the captured data.

The medical interview information control unit 203 stores the acquired medical interview information in the health management database (see FIG. 6). Note that the health management database shown in FIG. 6 is an example, and is not intended to limit the items to be stored. For example, the acquired biometric information of the user may be registered in a health management database.

The interview information control unit 203 acquires the biometric information of the user while the user is inputting the interview information (while inputting the interview information). Specifically, the interview information control unit 203 acquires image data (still image data, video data) including a facial image of the user by photographing the user who is inputting the interview information.

When acquiring video data, the medical interview information control unit 203 acquires, for example, approximately 30 seconds of video data.

Upon acquiring the user's biometric information (for example, video data obtained by photographing the user), the medical interview information control unit 203 estimates the user's vital data using the acquired biometric information.

For example, the medical interview information control unit 203 acquires estimated values of vital data such as the user's weight, heart rate, blood pressure, blood sugar level, and oxygen saturation level by analyzing the acquired biological information.

Note that analysis of biological information (video data including facial information) for estimating vital data may be performed using a learning model obtained by machine learning. For example, a company developing a health management application generates a learning model using a large amount of training data consisting of a combination of video data including facial information and vital data measurement results.

For example, the user's weight has a relationship with the outline of the face, etc., and a learning model that uses this relationship (a learning model that obtains the weight when a face image is input) can be generated. In addition, heart rate is related to changes in facial surface brightness (facial surface brightness caused by blood flow), and a learning model that utilizes this relationship (a learning model that obtains heart rate by inputting multiple facial images) has been developed. It is possible to generate Furthermore, facial swelling can be estimated from the physical distance of facial feature points and blood flow, and a learning model for estimating facial swelling can be generated.

The generated learning model is installed on the user terminal 10 as part of the health management application.

The medical interview information control unit 203 acquires estimated values of vital data by inputting the acquired biological information (for example, video data including facial information) into the learning model. The medical interview information control unit 203 stores the acquired estimated vital data values in a health management database.

The recurrence risk management unit 204 is a means for managing the user's disease recurrence risk. The recurrence risk management unit 204 has a function as a calculation unit (calculation means) that calculates a disease recurrence risk value indicating the user's disease recurrence risk based on the estimated vital data.

The recurrence risk management unit 204 quantifies the risk of recurrence of the user's disease periodically or at a predetermined timing. For example, the recurrence risk management unit 204 calculates a "disease recurrence risk value" at the timing when vital data is successfully estimated from the biological information obtained when inputting medical interview information. For example, the recurrence risk management unit 204 calculates a disease recurrence risk value in 10 stages.

For example, the recurrence risk management unit 204 calculates a disease recurrence risk value using the estimated vital data value. The recurrence risk management unit 204 can use the learning model to calculate the disease recurrence risk value.

Companies developing health management applications prepare a large amount of vital data (or a combination of multiple vital data) labeled with disease recurrence risk values as training data. Companies developing health management applications collect the above teacher data in cooperation with doctors and others with specialized knowledge.

Machine learning is performed using the collected training data, and a learning model (discriminator) is generated. Note that any algorithm such as support vector machine, boosting, neural network, etc. can be used to generate the learning model. It should be noted that since a well-known technique can be used for the algorithm such as the support vector machine, a description thereof will be omitted.

The recurrence risk management unit 204 obtains a disease recurrence risk value by inputting the latest vital data into the learning model.

Alternatively, the recurrence risk management unit 204 may calculate the disease recurrence risk value based on the interview information input by the user. For example, the recurrence risk management unit 204 calculates a high disease recurrence risk value when medical interview information such as a cough and inability to sleep is input. In this case as well, the recurrence risk management unit 204 may calculate the disease recurrence risk value using the learning model.

Alternatively, the health management application (recurrence risk management unit 204) may calculate the disease recurrence risk value based on the interview information (for example, subjective symptoms, exercise information, etc.) and the estimated vital data. In this case, the recurrence risk management unit 204 may use a learning model generated using medical interview information and vital data to which a label (disease recurrence risk value) is attached.

The recurrence risk management unit 204 stores the calculated disease recurrence risk value in the health management database.

The health information providing unit 205 is a means for providing information regarding the user's health. Specifically, the health information providing unit 205 provides information according to the calculated disease recurrence risk value. For example, the health information providing unit 205 provides information regarding the user's health to at least one of the user and the user's supporter based on the disease recurrence risk value.

The health information providing unit 205 performs processing according to the calculated disease recurrence risk value. The health information providing unit 205 accesses the health management database periodically or at a predetermined timing to obtain the latest disease recurrence risk value.

For example, if the disease recurrence risk value is lower than a predetermined value, the health information providing unit 205 does not perform any particular operation.

If the disease recurrence risk value is greater than or equal to a predetermined value, the health information providing unit 205 notifies the person and/or the supporter of the fact that the disease recurrence risk is high.

Specifically, the health information providing unit 205 generates health information including information regarding the user's health. For example, the health information providing unit 205 generates health information including disease recurrence risk values, estimated vital data values, interview information, and the like.

The health information providing unit 205 provides (notifies) the generated health information to the person and/or the supporter.

When providing health information to the user, the health information providing unit 205 displays a display as shown in FIG. 7 to notify the user of the fact that the risk of disease recurrence is increasing. At this time, the health information providing unit 205 may notify the user of the disease recurrence risk value, as shown in FIG. 7.

When providing health information to a supporter, the health information providing unit 205 sends the health information and the user's personal information (for example, A “health information notification” containing information such as name, etc.) is sent (see Figure 8). The supporter terminal 20 performs display using the health information included in the received health information notification.

For example, upon receiving the health information notification, the supporter terminal 20 displays a display as shown in FIG. Note that the display shown in FIG. 9 is an example, and is not intended to limit the content or display mode displayed on the supporter terminal 20. For example, the supporter terminal 20 may display data such as graphs showing time-series changes in the user's vital data (blood pressure, heart rate, etc.), medication status, etc. instead of or in addition to the disease recurrence risk value.

Note that the destination of the health information notification is stored in the user terminal 10 in advance. For example, the e-mail address of a family doctor or the like is registered in the user terminal 10 as a destination for health information notifications. When a user registers the contact information of a supporter in the user terminal 10, it is treated as consent (user consent) for information to be provided to the supporter. Alternatively, the destination of the health information notification may be stored in a server on the network (server on the cloud), another device, or the like. The user terminal 10 accesses the server on the cloud and other devices as necessary. The server or other device on the cloud may verify the authority of the user terminal 10, and if there is no problem with the verification, transmit the destination of the health information notification to the user terminal 10.

In this manner, the health information providing unit 205 notifies the user that the risk of disease recurrence is high when the disease recurrence risk value is greater than or equal to the predetermined value (first threshold). Alternatively, when the disease recurrence risk value is greater than or equal to a predetermined value (second threshold), the health information providing unit 205 notifies a support person who supports the user that the risk of disease recurrence is high. Note that the first threshold value and the second threshold value may be the same value or may be different values.

The storage unit 206 is a means for storing information necessary for the operation of the user terminal 10.

The operation of the user terminal 10 described above can be summarized as shown in the flowchart shown in FIG.

First, the user terminal 10 verifies the identity of the user who starts the health management application (step S101).

If the identity verification is successful, the user terminal 10 acquires medical interview information from the user (step S102).

The user terminal 10 acquires biometric information of the user by photographing the user while inputting medical interview information (step S103). For example, the user terminal 10 acquires still image data or video data obtained by photographing a user as biometric information.

The user terminal 10 estimates the user's vital data using the acquired biometric information (step S104).

The user terminal 10 calculates a disease recurrence risk value using at least the estimated value of vital data (step S105).

If the risk of disease recurrence is increasing, the user terminal 10 notifies the person and/or the supporter to that effect (notification of disease recurrence risk; step S106).

[Supporter terminal]
Examples of the supporter terminal 20 include mobile terminal devices such as smartphones, mobile phones, game consoles, and tablets, computers (personal computers, notebook computers), and the like. The supporter terminal 20 can be any equipment or device as long as it can accept operations from the supporter and communicate with the user terminal 10 and the like. Furthermore, since the configuration of the supporter terminal 20 is obvious to those skilled in the art, detailed explanation will be omitted.

As described above, the user terminal 10 according to the first embodiment acquires biometric information of a user who is at risk of disease recurrence, and estimates vital data based on the acquired biometric information. The user terminal 10 calculates the user's disease recurrence risk value using the estimated vital data, and provides information according to the calculated risk value. For example, if it is determined that the risk (possibility) of disease recurrence is high, the user terminal 10 notifies the user or his or her supporter to that effect. In order to prevent the recurrence of diseases such as heart failure, it is necessary to recognize the symptoms in advance and take appropriate measures. When the user terminal 10 detects signs of disease recurrence based on estimated vital data, etc., the user terminal 10 notifies the user and his/her supporters (family doctor, family, care staff, etc.) of this fact. As a result, appropriate treatment can be taken before the disease actually occurs again, and disease recurrence can be prevented.

Next, the hardware of the user terminal 10 will be explained. FIG. 11 is a diagram showing an example of the hardware configuration of the user terminal 10.

The user terminal 10 can be configured by an information processing device (so-called computer), and has the configuration illustrated in FIG. 11. For example, the user terminal 10 includes a processor 311, a memory 312, an input/output interface 313, a communication interface 314, and the like. The components such as the processor 311 are connected by an internal bus or the like and are configured to be able to communicate with each other.

However, the configuration shown in FIG. 11 is not intended to limit the hardware configuration of the user terminal 10. The user terminal 10 may include hardware not shown, and may not include the input/output interface 313 if necessary. Furthermore, the number of processors 311 and the like included in the user terminal 10 is not limited to the example shown in FIG. 11; for example, a plurality of processors 311 may be included in the user terminal 10.

The processor 311 is, for example, a programmable device such as a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or a DSP (Digital Signal Processor). Alternatively, the processor 311 may be a device such as an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). The processor 311 executes various programs including an operating system (OS).

The memory 312 is a RAM (Random Access Memory), a ROM (Read Only Memory), an HDD (Hard Disk Drive), an SSD (Solid State Drive), or the like. The memory 312 stores OS programs, application programs, and various data.

The input/output interface 313 is an interface for a display device or input device (not shown). The display device is, for example, a liquid crystal display. The input device is, for example, a device such as a keyboard or a mouse that receives user operations.

The communication interface 314 is a circuit, module, etc. that communicates with other devices. For example, the communication interface 314 includes a NIC (Network Interface Card).

The functions of the user terminal 10 are realized by various processing modules. The processing module is realized, for example, by the processor 311 executing a program stored in the memory 312. Further, the program can be recorded on a computer-readable storage medium. The storage medium can be non-transitory, such as a semiconductor memory, a hard disk, a magnetic recording medium, an optical recording medium, etc. That is, the present invention can also be implemented as a computer program product. Furthermore, the above program can be updated via a network or by using a storage medium that stores the program. Furthermore, the processing module may be realized by a semiconductor chip.

The user terminal 10, which is an information processing device, is equipped with a computer, and the functions of the user terminal 10 can be realized by having the computer execute a program. Further, the user terminal 10 executes the control method for the user terminal 10 using the program.

[Modified example]
Note that the configuration, operation, etc. of the information processing system described in the above embodiments are merely examples, and are not intended to limit the configuration, etc. of the system.

In the above embodiment, explanation was given using heart failure as an example of a disease with a risk of recurrence. However, diseases to which the present disclosure is applicable are not limited to heart failure. The present disclosure is applicable to any disease. For example, the user terminal 10 (health management application) disclosed in the present application is capable of providing information regarding not only heart failure but also recurrence or aggravation of other diseases such as circulatory diseases and diabetes.

In the above embodiment, it has been explained that identity verification is performed when starting the health management application. However, if identity verification is performed when the user terminal 10 is activated, the identity verification upon activation of the health management application may be omitted.

When acquiring biometric information (still image data or video data) of a user who is inputting medical interview information, the user terminal 10 may acquire consent from the user to photograph the user. Alternatively, the user terminal 10 may display the image data being captured on the interview information input screen.

In the above embodiment, a case has been described in which the user terminal 10 acquires medical interview information using a GUI as shown in FIG. However, the interview information may be obtained by other methods. For example, the user terminal 10 may acquire medical interview information through voice input. Alternatively, the user terminal 10 may acquire medical interview information by selecting questions or responding through a chatbot or the like.

In the above embodiment, a case has been described in which the user terminal 10 acquires medical interview information from the user himself/herself using the GUI. However, the user terminal 10 may estimate all or part of the interview information depending on the manner in which the user operates the user terminal 10 (how the user operates). For example, the user terminal 10 may estimate the presence or absence of "dementia" based on the accuracy and smoothness of character input by the user. For example, the user terminal 10 determines that the user is spending a lot of time inputting data or that the number of input errors has increased significantly based on the time required for past data input and the frequency of input errors. In some cases, the user may be presumed to be suffering from "dementia."

In the above embodiment, it has been explained that the user terminal 10 acquires biological information (image data including a face image) necessary for estimating vital data while the user is inputting medical interview information. However, the biometric information may be acquired not only when inputting medical interview information but also when the user is operating another application or the like. For example, the user terminal 10 may acquire biometric information while the user is using an SNS (Social Networking Service) application or browsing a WEB page.

The user terminal 10 may acquire all or part of the medical interview information (for example, medication information, sleep information, etc.) from an application different from the health management application. For example, the user terminal 10 may acquire medical interview information from an application that manages medication, an application that measures the quality of sleep, or the like.

If the user terminal 10 detects that medical interview information is not regularly input, it may notify a support person (for example, a family doctor or a family member) of this fact. Alternatively, if the user terminal 10 determines that the user has not taken the necessary medication (forgot to take the medication) based on the acquired interview information, the user terminal 10 may notify the user or a supporter (for example, a family member) to that effect. may be notified. Alternatively, if the user terminal 10 is able to obtain the user's meal contents and the user is consuming too much salt or not enough water, the user terminal 10 notifies the user or a supporter to that effect. You may.

The user may wear a terminal (so-called wearable device) that can measure blood pressure, heart rate, etc. The user terminal 10 may acquire vital data from the wearable device. Specifically, the user terminal 10 may acquire vital data measured by the wearable device using short-range wireless communication means such as Bluetooth (registered trademark). The user terminal 10 may use vital data acquired from a wearable device as all or part of the vital data necessary for calculating the disease recurrence risk value. That is, the user terminal 10 may calculate the disease recurrence risk value using vital data acquired from other devices (health equipment; for example, a wearable device, a scale, a blood pressure monitor).

The user terminal 10 may acquire image data showing not only the user's face but also the entire user as biometric information. Alternatively, the user terminal 10 may acquire image data showing part of the user's face as biometric information. For example, the user terminal 10 may acquire image data (still image data, video data) showing both eyes (pupils) of the user as biometric information.

The user terminal 10 may estimate vital data using the acquired whole body image data and pupil image data. For example, the user terminal 10 may estimate heart rate, breathing rate, etc. from shoulder movements, or may acquire the size (dilation) of pupils as vital data.

The user terminal 10 (interview information control unit 203) may use different biological information (still image data, video data) and learning models depending on the type of vital data to be estimated. For example, when estimating the weight, the user terminal 10 estimates the user's weight by inputting still image data (part of the video data) to a learning model dedicated to weight estimation. Alternatively, when estimating blood pressure or heart rate, the user terminal 10 inputs video data (a plurality of still image data) into a learning model dedicated to blood pressure estimation or heart rate estimation, so that the user's Estimate blood pressure and heart rate. The user terminal 10 can obtain more accurate vital data by using biological information and a learning model suitable for the vital data to be estimated. Alternatively, the user terminal 10 may acquire video data or the like suitable for the vital data to be estimated. For example, the user terminal 10 may acquire (generate) a video with a frame rate suitable for the estimated vital data.

The user terminal 10 may use the acquired biometric information for purposes other than estimating vital data. For example, the user terminal 10 may estimate the presence or absence of dementia, the presence or absence of a genetic disease, etc. using the acquired biological information. For example, the user terminal 10 may determine the presence or absence of dementia, the presence or absence of a genetic disease, etc. by inputting still image data including a user's face image into a learning model.

Alternatively, the user terminal 10 may estimate (generate) the interview information using the acquired biometric information. For example, the user terminal 10 may estimate "easiness to get tired" by inputting a face image into a learning model. Alternatively, the user terminal 10 may estimate the user's emotions (emotions, anger, sadness, and happiness) by inputting the acquired biological information into a learning model. That is, the user terminal 10 may estimate the user's emotions (feelings, mood) by analyzing the user's “facial expressions”. Alternatively, the user terminal 10 may use different learning models or the like depending on the age of the user.

The user terminal 10 may calculate the disease recurrence risk value using not only the latest vital data estimate but also the vital data estimate acquired in the past. For example, the user terminal 10 may calculate the disease recurrence risk value by inputting estimated values of vital data acquired over a predetermined period (for example, one week) into a learning model. In this case, the disease recurrence risk value is calculated by taking into account the change (rate of change) in the estimated value of vital data, so that the disease recurrence risk can be grasped more accurately. Similarly, the user terminal 10 may calculate a disease recurrence risk value using estimated values of vital data and interview information for a predetermined period.

In the above embodiment, it has been explained that the user terminal 10 does not perform any special operation (notification) when the disease recurrence risk value is lower than a predetermined value. However, if the disease recurrence risk value is low, the user terminal 10 may notify the user or the supporter of the fact that the disease recurrence risk is low.

The user terminal 10 may change the health information notification destination and notification content depending on the degree of disease recurrence risk. For example, if the risk of disease recurrence is extremely high (if the disease recurrence risk value is greater than a predetermined threshold), the user terminal 10 notifies the person and the support person to that effect. On the other hand, if the risk of recurrence is not so high, the user terminal 10 may limit itself to giving the person advice on how to improve his or her lifestyle. The user terminal 10 sends health information to the user when the disease recurrence risk value exceeds a first threshold, and sends support to the user when the disease recurrence risk value exceeds a second threshold. You may send health information to others.

The health notebook (collection of medical interview information and estimated vital data) generated by the user terminal 10 may be shared with medical institutions and the like. For example, a user may operate the user terminal 10 to submit a health notebook (contents of a health management database) to a medical institution during online medical treatment.

In the above embodiment, it has been explained that the health information (disease recurrence risk value, medical interview information, estimated vital data) generated by the user terminal 10 is provided to supporters and the like. However, the health information may also be provided to public institutions such as private companies and local governments. For example, the user terminal 10 may provide interview information and estimated values of vital data to an insurance company or retailer with the consent of the user. Money may be paid to the user who provided the interview information and estimated vital data. That is, a data utilization business regarding medical interview information and estimated values of vital data may be conducted. For example, data may be provided to insurance companies for the development of insurance products, or data may be provided to retailers to promote health foods.

The user terminal 10 may award points to the user each time the user inputs the interview information, in order to motivate the user to input the interview information.

In the above embodiment, a case has been described in which the health management database is configured inside the user terminal 10, but the database may be configured in an external database server or the like. That is, the information processing system may include a server device, and the server device may manage the health status (interview information, estimated vital data) of each user. Further, the server device may perform control regarding notification of health information (provision of health information). That is, some functions of the user terminal 10 may be implemented in another apparatus, device, or the like.

The form of data transmission and reception between each device (user terminal 10, supporter terminal 20) is not particularly limited, but data transmitted and received between these devices may be encrypted. Personal information such as medical interview information is transmitted and received between these devices, and in order to appropriately protect this information, it is desirable that encrypted data be transmitted and received.

Although a plurality of steps (processes) are described in order in the flowcharts (flowcharts, sequence diagrams) used in the above description, the order in which the steps are executed in the embodiment is not limited to the order in which they are described. In the embodiment, the order of the illustrated steps can be changed within a range that does not affect the content, such as executing each process in parallel, for example.

The above embodiments have been described in detail to facilitate understanding of the present disclosure, and it is not intended that all the configurations described above are necessary. Further, when a plurality of embodiments are described, each embodiment may be used alone or in combination. For example, it is also possible to replace a part of the configuration of the embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of the embodiment. Furthermore, it is possible to add, delete, or replace some of the configurations of the embodiments with other configurations.

The industrial applicability of the present invention is clear from the above description, and the present invention is suitably applicable to information processing systems that provide health-related information to users.

Part or all of the above embodiments may be described as in the following additional notes, but are not limited to the following.
[Additional note 1]
an acquisition means for acquiring biometric information of a user;
Estimating means for estimating vital data based on the acquired biological information;
Calculation means for calculating a disease recurrence risk value indicating the risk of disease recurrence of the user based on the estimated vital data;
Providing means for providing information according to the calculated disease recurrence risk value;
A terminal equipped with
[Additional note 2]
The acquisition means acquires interview information of the user,
The terminal according to supplementary note 1, wherein the calculation means calculates the disease recurrence risk value based on the interview information and the estimated vital data.
[Additional note 3]
The terminal according to supplementary note 2, wherein the acquisition means acquires the biometric information while the user is inputting the medical interview information.
[Additional note 4]
The terminal according to appendix 3, wherein the providing means provides information regarding the user's health to at least one of the user and the user's supporter based on the disease recurrence risk value.
[Additional note 5]
The terminal according to supplementary note 4, wherein the providing means notifies the user that the risk of disease recurrence is high when the disease recurrence risk value is equal to or higher than a predetermined value.
[Additional note 6]
The terminal according to supplementary note 4, wherein the providing means notifies a supporter who supports the user that the risk of disease recurrence is high when the disease recurrence risk value is equal to or higher than a predetermined value.
[Additional note 7]
The terminal according to supplementary note 4, further comprising an identity verification means for verifying the identity of the user before the user inputs the medical interview information.
[Additional note 8]
8. The terminal according to any one of Supplementary Notes 1 to 7, wherein the acquisition means acquires still image data or video data obtained by photographing the user as the biometric information.
[Additional note 9]
At the terminal,
Obtain the user's biometric information,
Estimating vital data based on the acquired biological information,
Calculating a disease recurrence risk value indicating the user's disease recurrence risk based on the estimated vital data,
A terminal control method for providing information according to the calculated disease recurrence risk value.
[Additional note 10]
On the computer installed in the terminal,
Processing to obtain biometric information of the user;
a process of estimating vital data based on the acquired biological information;
a process of calculating a disease recurrence risk value indicating the disease recurrence risk of the user based on the estimated vital data;
a process of providing information according to the calculated disease recurrence risk value;
A computer-readable storage medium that stores a program for executing.

Furthermore, each disclosure of the cited prior art documents mentioned above shall be incorporated into this document by reference. Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. It will be understood by those skilled in the art that these embodiments are illustrative only and that various modifications can be made without departing from the scope and spirit of the invention. That is, it goes without saying that the present invention includes the entire disclosure including the claims and various modifications and modifications that can be made by those skilled in the art in accordance with the technical idea.

10 User terminal 20 Supporter terminal 100 Terminal 101 Acquisition means 102 Estimation means 103 Calculation means 104 Providing means 201 Communication control section 202 Identity confirmation section 203 Medical interview information control section 204 Recurrence risk management section 205 Health information provision section 206 Storage section 311 Processor 312 Memory 313 Input/output interface 314 Communication interface

Claims

an acquisition means for acquiring biometric information of a user;
Estimating means for estimating vital data based on the acquired biological information;
Calculation means for calculating a disease recurrence risk value indicating the risk of disease recurrence of the user based on the estimated vital data;
Providing means for providing information according to the calculated disease recurrence risk value;
A terminal equipped with
The acquisition means acquires interview information of the user,
The terminal according to claim 1, wherein the calculation means calculates the disease recurrence risk value based on the interview information and the estimated vital data.
The terminal according to claim 2, wherein the acquisition means acquires the biometric information while the user is inputting the medical interview information.
The terminal according to claim 3, wherein the providing means provides information regarding the user's health to at least one of the user and the user's supporter based on the disease recurrence risk value.
The terminal according to claim 4, wherein the providing means notifies the user that the risk of disease recurrence is high when the disease recurrence risk value is equal to or higher than a predetermined value.
5. The terminal according to claim 4, wherein the providing means notifies a supporter who supports the user that the risk of disease recurrence is high when the disease recurrence risk value is equal to or higher than a predetermined value.
The terminal according to claim 4, further comprising an identity verification means for verifying the identity of the user before the user inputs the medical interview information.
The terminal according to any one of claims 1 to 7, wherein the acquisition means acquires still image data or video data obtained by photographing the user as the biometric information.
At the terminal,
Obtain the user's biometric information,
Estimating vital data based on the acquired biological information,
Calculating a disease recurrence risk value indicating the user's disease recurrence risk based on the estimated vital data,
A terminal control method for providing information according to the calculated disease recurrence risk value.
On the computer installed in the terminal,
Processing to obtain biometric information of the user;
a process of estimating vital data based on the acquired biological information;
a process of calculating a disease recurrence risk value indicating the risk of disease recurrence of the user based on the estimated vital data;
a process of providing information according to the calculated disease recurrence risk value;
A computer-readable storage medium that stores a program for executing.