JP2023021739A - health checkup system - Google Patents

Abstract

To provide a system with which health checkup can be easily performed and in which a checkup range is expanded.SOLUTION: There is provided a health checkup system 1 including: a portable terminal device 3 which can be carried by a checkup object person and incorporates a camera; and a health checkup device 2 which checks the health condition of the checkup object person. The portable terminal device 3 comprises an information transmission/reception unit 311 which transmits appearance image information of a user U being the checkup object person imaged by the camera to the health checkup device 2 connected to the network. The health checkup device 2 comprises: a checkup unit 211 which checks the health condition of the checkup object person on the basis of the appearance image information and health information transmitted from the portable terminal device 3; and a notification unit 212 which transmits the checkup result by the checkup unit 211 to the portable terminal device 3.SELECTED DRAWING: Figure 1

Description

The present invention relates to a system for diagnosing the health condition of a person to be diagnosed.

A system for diagnosing the health condition of a person to be diagnosed is known. For example, Patent Literature 1 below describes that a patient transmits his/her own voice information to a medical institution and determines whether or not the patient is ill based on the patient's voice information. Patent Document 2 below describes interactive monitoring of a patient's disease or health condition.

WO 03/068062 JP 2006-075593 A

Health check-ups not only enable early detection of diseases, but also have the great advantage of being able to know the stages just before they become ill, thereby preventing them from becoming ill. However, conventional medical examinations are not readily available, and are generally about once a year.

Therefore, even if it is supplementary, if there is a device system that makes health checkups easier and more frequent, it would be possible not only to detect diseases early, but also to prevent them more effectively. It is thought that there is no.

JP-A No. 2002-300001 describes that whether or not a patient is ill is determined based on voice information, but the range of diagnosis that can be made from voice alone is greatly limited. Although Patent Document 2 mentioned above describes interactive monitoring of a patient's disease and health condition, it cannot be said to be very handy because it is interactive.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a system that facilitates a health checkup and expands the range of diagnosis.

A health checkup system according to one aspect of the present invention includes a mobile terminal device with a built-in camera carried by a person to be diagnosed, and a health checkup device for diagnosing the health condition of the person to be diagnosed. wherein the portable terminal device transmits external image information of the person to be diagnosed photographed by the camera and health information indicating the health condition of the person to be diagnosed, which is connected to the network. An information transmitting/receiving unit for transmitting information to a health diagnosis device, and the health diagnosis device diagnoses the health condition of the person to be diagnosed based on the appearance image information and the health information transmitted from the mobile terminal device. and a notification unit configured to transmit information indicating a diagnosis result of the diagnosis to the portable terminal device.

According to the health checkup system according to the present invention, the health condition is diagnosed using appearance images and health information instead of voice, so it is possible to widen the range of diagnosis than before. For example, it becomes possible to detect an abnormality such as swelling of the eyes or neck from the appearance image of the person to be diagnosed.

Appearance image information used for diagnosis is acquired by a mobile terminal device (for example, a smart phone) that can be carried by the person to be diagnosed, and is transmitted from the mobile terminal device to the health checkup apparatus. That is, the person to be diagnosed can undergo a physical examination simply by using the mobile terminal device, so that according to the present invention, the physical examination can be easily performed. Therefore, according to the present invention, it is possible to easily perform a health examination and expand the scope of diagnosis.

It is a figure showing the whole medical examination system concerning one embodiment of the present invention. 2 is a functional block diagram schematically showing the main internal configuration of the health checkup apparatus; FIG. 2 is a functional block diagram schematically showing the main internal configuration of a mobile terminal device; FIG. 4 is a flow chart showing an example of processing performed by a control unit of the health checkup apparatus; FIG. 10 is a diagram showing an example of a health checkup scenario; FIG. 10 is a diagram showing an example of a health checkup scenario; It is a figure which shows an example of the notification which shows a diagnosis result. It is a figure which shows an example of the notification which shows a diagnosis result.

A health checkup system according to an embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing the entire medical examination system according to one embodiment of the present invention.

The health checkup system 1 includes a health checkup device 2 existing on the cloud 5, a mobile terminal device 3 with a built-in camera that can be carried by a user U who is a person to be diagnosed, and an activity base of the user U. and a smart speaker 4 installed in a home or the like. The health checkup device 2, the mobile terminal device 3, and the smart speaker 4 are connected to each other through a network such as the Internet. The mobile terminal device 3 is, for example, a mobile device such as a smart phone capable of data communication through a network.

The health checkup device 2 is, for example, a server, and diagnoses the health condition of the user U, who is the person being diagnosed, by an installed health checkup program. The mobile terminal device 3 transmits appearance image information of the user U captured by the camera to the health checkup device 2 connected to the network. The smart speaker 4 is capable of data communication through a network, and is, for example, a speaker having an AI (artificial intelligence) assistant function.

FIG. 2 is a functional block diagram schematically showing the main internal configuration of the health checkup apparatus 2. As shown in FIG. The health checkup device 2 includes a control unit 21 , a communication section 22 and a storage device 23 .

The communication unit 22 is a communication interface that performs data communication with external devices on the network. For example, the communication unit 22 performs data communication with the mobile terminal device 3 and smart speaker 4 .

The storage device 23 is a large-capacity storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage device 23 stores various control programs and, as part of its storage area, a health checkup data storage unit 230, an attribute information storage unit 231, an appearance image information storage unit 232, and a biological information storage unit 233. , provided.

The health checkup data storage unit 230 stores health checkup data including information on human health and illness (symptoms, causes, etc.). For example, health checkup data is created by analyzing medical information collected from medical institutions and patients, and stored in the health checkup data storage unit 230 .

The attribute information storage unit 231 stores the name, height, weight, sex, age (date of birth), medical history, etc. of the user U as attribute information of the user U who is the person to be diagnosed. The appearance image information storage unit 232 stores the appearance image information of the user U (including the shooting date and time or the transmission date and time) transmitted from the mobile terminal device 3 . The biometric information storage unit 233 stores biometric information of the user U (for example, heart rate, blood pressure, body temperature, etc.).

The control unit 21 includes a processor, RAM (Random Access Memory), ROM (Read Only Memory), and a dedicated hardware circuit. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit). The control unit 21 includes a control section 210 , a diagnosis section 211 , a notification section 212 and a request section 213 .

The control unit 21 functions as a control section 210 , a diagnosis section 211 , a notification section 212 , and a request section 213 by the operation of the processor according to the health checkup program stored in the storage device 23 . However, the control unit 210 and the like can be configured by hardware circuits, regardless of the operation according to the health checkup program by the control unit 21 . Hereinafter, the same applies to each embodiment unless otherwise specified.

The control unit 210 controls the overall operation of the health checkup device 2 . The control unit 210 is connected to the communication unit 22 and the storage device 23, and controls the operations of the connected components and transmits/receives signals or data to/from the components. For example, the control unit 100 stores information transmitted from the mobile terminal device 3 in one of the attribute information storage unit 231, the appearance image information storage unit 232, and the biometric information storage unit 233 according to the content of the information. .

The diagnosis unit 211 diagnoses the person to be diagnosed based on the appearance image information transmitted from the portable terminal device 3, the health information including the health checkup data, the attribute information of the user U, and the biometric information of the user U. The health condition of user U is diagnosed.

The notification unit 212 notifies the user U, who is the person being diagnosed, of the diagnosis result by the diagnosis unit 211 . For example, the notification unit 212 notifies the user U of the diagnosis result by transmitting information indicating the diagnosis result to the mobile terminal device 3 via the communication unit 22 .

The requesting unit 213 transmits an instruction to the mobile terminal device 3 to request transmission of health information indicating the health condition of the person to be diagnosed based on the diagnosis result by the diagnosis unit 211 as necessary.

FIG. 3 is a functional block diagram schematically showing the main internal configuration of the mobile terminal device 3. As shown in FIG. The mobile terminal device 3 includes a control unit 31 , a display section 32 , a touch panel 33 , a camera 34 , a communication section 35 , a storage device 36 and physical keys 37 . Each of these components can transmit and receive data or signals to and from each other via a communication bus.

The display unit 32 is configured by a liquid crystal display (Liquid Crystal Display), an organic EL (OLED: Organic Light-Emitting Diode), or the like. The display unit 32 also displays responses from the control unit 31, data results, and the like.

The touch panel 33 is a touch panel of a so-called resistive film type, capacitive type, or the like. The touch panel 33 is arranged on the front surface of the display unit 32, and detects a touch by the user on the display surface of the display unit 32 together with the touch position. When the touch panel 33 detects a contact by the user, the touch panel 33 outputs a detection signal indicating the coordinate position of the contact point to the control unit 31 . In this way, the touch panel 33 serves as an operation unit through which user operations on the display surface of the display unit 32 are input.

In addition to the touch panel 33 described above, the mobile terminal device 3 includes physical keys 37 as an operation unit for inputting user operations. The physical key 37 includes, for example, a power button.

The camera 34 shoots an image by a shooting operation by the user U, for example. The camera 34 also takes pictures during face authentication when unlocking the mobile terminal device 3 .

The communication unit 35 is a communication interface including a communication module. The mobile terminal device 3 is connected to an external device via a network, and performs data communication with the health checkup device 2 and the smart speaker 4 connected by the communication unit 35 . Also, the mobile terminal device 3 can communicate directly with the smart speaker 4 via the communication unit 35 on a one-to-one basis, not via a network, but via direct communication.

The storage device 36 is a non-volatile memory such as flash memory, and stores various control programs and the like. A health checkup application 360 is installed in the mobile terminal device 3 , and the health checkup application 360 is stored in the storage device 36 .

The control unit 31 includes a processor, RAM, ROM, and dedicated hardware circuits. A processor is, for example, a CPU, an ASIC, or an MPU. The control unit 31 includes a control section 310 , an information transmission/reception section 311 , an output section 312 and a biological information acquisition section 313 .

The control unit 31 functions as the control unit 310 by the operation by the processor according to the control program stored in the storage device 36, and the operation by the processor according to the health checkup application 360 stored in the storage device 36. , an information transmission/reception unit 311 , an output unit 312 , and a biological information acquisition unit 313 .

The control unit 310 controls the overall operation of the mobile terminal device 3 . The control unit 310 is connected to the display unit 32, the touch panel 33, the camera 34, the communication unit 35, the storage device 36, and the physical key 37, and controls the operations of the above-described connected components and controls the connection between the components. send and receive signals or data in

The information transmitting/receiving section 311 transmits various types of information via the communication section 35 to the health diagnosis device 2 connected to the network. For example, the information transmitting/receiving unit 311 transmits attribute information such as the name, height, weight, sex, date of birth, and medical history input by the user U who is the person to be diagnosed to the health checkup apparatus 2, or Appearance image information of the user U, who is the person being diagnosed, captured by the camera 34 is transmitted to the health checkup apparatus 2 via the communication unit 35 .

Further, upon receiving a request for transmission of health information from the health checkup device 2 via the communication unit 35, the information transmission/reception unit 311 transmits the health information to the health checkup device 2 based on the request. In addition, the information transmitting/receiving unit 311 transmits a photographic image (hereinafter referred to as appearance image information) showing the appearance of the user U who is the person to be diagnosed photographed by the camera 34 to the health diagnosis apparatus 2 via the communication unit 35 . do.

For example, the information transmitting/receiving unit 311 receives appearance image information captured by the camera 34 at the time of face authentication for unlocking the mobile terminal device 3, appearance image information obtained by taking a so-called self-portrait using the camera 34, Appearance image information obtained by photographing by another person using the camera 34 is acquired, and the acquired appearance image information is transmitted to the health checkup apparatus 2 via the communication unit 35 . That is, the appearance image information is transmitted to the health checkup apparatus 2 even without the user U's voluntary operation and without the user U being conscious of it, so convenience is improved.

When the communication unit 35 receives the information indicating the diagnosis result transmitted from the health examination device 2, the output unit 312 performs processing for providing the information to the user U who is the person to be diagnosed. For example, the output unit 312 causes the display unit 32 to display the diagnosis result. Thereby, the user U is notified of the information indicating the diagnosis result.

The biometric information acquisition unit 313 acquires biometric information of the user U who is the subject of diagnosis. For example, when a heart rate sensor or a blood pressure sensor (not shown) worn on the arm of the user U is linked to the mobile terminal device 3, the biological information acquisition unit 313 detects the heart rate sensor, the blood pressure sensor, or the like from the heart rate sensor, the blood pressure sensor, or the like to the user. Obtain U's heart rate information or blood pressure information.

Next, an example of processing performed by the health checkup apparatus 2 regarding the diagnosis of the health condition of the user U who is the person to be diagnosed and the notification of the diagnosis result will be described with reference to the flowchart shown in FIG. 4 and the like.

The diagnosis unit 211 of the health checkup apparatus 2 stores the health checkup data stored in the health checkup data storage unit 230 and the subject of diagnosis stored in the attribute information storage unit 231 at a predetermined cycle (for example, one week). By analyzing the attribute information of the user U who is a person, the biometric information of the user U stored in the biometric information storage unit 233, and the appearance image information of the user U stored in the appearance image information storage unit 232, The health condition of user U is diagnosed (S1). For example, as one of these diagnoses, the diagnosis unit 211 diagnoses the health condition of the person to be diagnosed by comparing the past appearance of the person to be diagnosed and the current appearance of the person to be diagnosed based on appearance image information.

The request unit 213 determines whether or not the diagnosis result of the health condition of the user U is “abnormal” (S2). It is determined whether long-term observation of the user U who is the diagnostician is necessary (S3).

When the request unit 213 determines that long-term observation is not necessary (NO in S3), the notification unit 212 transmits information indicating the diagnosis result by the diagnosis unit 211 to the user U who is the person to be diagnosed via the communication unit 22. transmits to the portable terminal device 3 carried by (S4). After this, the process ends. When the mobile terminal device 3 receives the information, the output unit 312 causes the display unit 32 to display the diagnosis result indicated by the information.

As another embodiment, the output unit 312 of the mobile terminal device 3 does not cause the display unit 32 to display the diagnosis result, but the smart speaker 4 is within a predetermined range from the mobile terminal device 3 (for example, smart If the speaker 4 is within a Wi-Fi connectable range of the mobile terminal device 3), the output unit 312 transmits the information transmitted from the health checkup device 2 to the smart speaker 4, and the smart speaker 4 may output the diagnosis result by voice. Further, if the mobile terminal device 3 is equipped with a speaker, the output unit 312 may output the diagnosis result by voice from the speaker.

On the other hand, in S3, when the requesting unit 213 determines that long-term observation is necessary (YES in S3), the requesting unit 213 periodically transmits ( For example, once a week transmission) is requested (S5). Note that the request unit 213 may change the transmission cycle of the appearance image information according to the diagnosis result. After that, the process ends, but when the predetermined period comes, the diagnosis unit 211 further uses the latest appearance image information obtained by the periodic transmission to estimate the health condition of the user U. A diagnosis is made.

When the mobile terminal device 3 receives the above request, the information transmitting/receiving unit 311 transmits the appearance image information of the user U who is the person to be diagnosed photographed by the camera 34 to the health checkup device 2 as instructed by the above request. Send regularly to the street. As a result, the health checkup apparatus 2 periodically acquires the appearance image information of the person to be diagnosed, so that the diagnosis unit 211 can make a more accurate diagnosis based on the latest information. .

In S2, if the requesting unit 213 does not determine that the diagnosis result is "abnormal" (NO in S2), it determines whether or not additional information is necessary for diagnosing the health condition of the person being diagnosed (S6). ).

If the requesting unit 213 determines that the additional information is necessary (YES in S6), the required additional information is specified based on the diagnosis result in S1 (S7), and the specified additional information is transmitted from the mobile terminal device. 3 (S8). After that, the process ends, but when the requested predetermined period comes, the diagnosis unit 211 diagnoses the health condition of the user U using the additional information obtained by the request. .

For example, in the diagnosis in S1, if no diagnostic results have been obtained for eyes or neck, the requesting unit 213 requests the body part (eyes, neck, etc.) of the person to be diagnosed as the additional information necessary for diagnosis. Identify. When the requesting unit 213 specifies in this way, it requests the mobile terminal device 3 to transmit appearance image information showing the specified body part.

When the information transmitting/receiving unit 311 of the portable terminal device 3 receives a request for appearance image information showing body parts from the medical examination device 2, the information transmitting/receiving unit 311 responds to the above-mentioned request of the person to be diagnosed photographed by the camera 34. Appearance image information in which the body part to be examined is shown is transmitted to the health checkup apparatus 2 via the communication unit 35 . For example, when the mobile terminal device 3 is requested to transmit left eye appearance image information, the information transmitting/receiving unit 311 extracts the left eye image from the stored photographic image of the face taken by the camera 34 at the time of face authentication. is acquired, and the photographic image as appearance image information including the left eye image is transmitted to the health checkup apparatus 2 via the communication unit 35 . As a result, the health checkup apparatus 2 can acquire, as additional information, appearance image information of a specific part for which no diagnosis result has been obtained. A more complete diagnosis can be made by performing further diagnosis at

Further, when the requesting unit 213 specifies the biometric information (heart rate, etc.) of the person to be diagnosed as the additional information necessary for the diagnosis, the request unit 213 requests the mobile terminal device 3 to transmit the specified biometric information.

When the information transmitting/receiving unit 311 of the mobile terminal device 3 receives the request for the biometric information from the health checkup device 2, the information transmitting/receiving unit 311 receives the biometric information of the user U who is the person to be diagnosed, which is acquired by the biometric information acquisition unit 313. It is transmitted to the health checkup device 2 . In this case, the health checkup apparatus 2 performs a further diagnosis using biological information for which no diagnosis result has been obtained as additional information, so that a more complete diagnosis can be performed.

In S6, when the requesting unit 213 determines that the additional information is not necessary (NO in S6), the process ends. This is because the health condition of the user U, who is the person being diagnosed, is recognized as "no abnormality".

According to the above-mentioned health checkup system, the health condition is diagnosed not by voice but by external images, so that it is possible to expand the range of diagnosis as compared with the conventional system. For example, it becomes possible to detect an abnormality such as swelling of the eyes or neck from the appearance image of the person to be diagnosed.

Appearance image information used for diagnosis is acquired by a mobile terminal device 3 (for example, a smart phone) that can be carried by the person to be diagnosed, and is transmitted from the mobile terminal device 3 to the health checkup device 2 . In other words, the person to be diagnosed can receive the physical examination simply by using the portable terminal device 3, so that the physical examination can be easily performed. Therefore, it is possible to easily perform a health checkup and further expand the scope of the checkup.

In the above embodiment, the case where the notification unit 212 transmits information indicating the diagnosis result by the diagnosis unit 211 to the mobile terminal device 3 is described. By transmitting not only the diagnosis result by 211 but also information including the observation progress up to that point by the diagnosis unit 211 to the portable terminal device 3, the observation progress is also transmitted to the portable terminal device 3. You may do so.

By using the health checkup system 1 as described above, a health checkup scenario such as that shown in FIG. 5 or 6 can be realized, enabling early detection of illness.

Scenario SCE1 shown in FIG. 5 is a health examination for a woman named Wendy for about four months from January 1, 2020 to May 15, 2020. Scenario SCE2 shown in FIG. 6 is a health examination for a woman named Joan for two days from January 1st to January 2nd, 2020.

FIG. 7 is a diagram showing an example of a notification sent from the health checkup apparatus 2 to Wendy who is the person being diagnosed. The notification N1 shown in FIG. 7 describes the diagnosis results and observation progress for Wendy. FIG. 8 is a diagram showing an example of a notification sent from the health checkup apparatus 2 to Joan who is a person to be diagnosed. The notification N2 shown in FIG. 8 describes the diagnosis results and observation progress for Joanne.

The present invention is not limited to the configuration of the above embodiment, and various modifications are possible. For example, the notification unit 212 of the health checkup device 2 updates, for a certain period of time (for example, You may make it transmit to the portable terminal device 3 via the communication part 22 every one week). In the portable terminal device 3, when the communication section 35 receives the latest appearance image information and the biological information, the output section 312 causes the display section 32 to display the latest appearance image information and the biological information. As a result, the user U can be given an opportunity to grasp his or her health condition, which changes over time.

In addition, in the above embodiment, the configuration and processing shown in the above embodiment using FIGS. 1 and 8 are merely one embodiment of the present invention, and are not intended to limit the present invention to the configuration and processing.

1 Health checkup system 2 Health checkup device 3 Portable terminal device 34 Camera 211 Diagnosis unit 212 Notification unit 213 Request unit 311 Information transmission/reception unit 313 Biological information acquisition unit

Claims (8)

A health checkup system comprising a portable terminal device with a built-in camera carried by a person to be diagnosed, and a health checkup device for diagnosing the health condition of the person to be diagnosed,
The mobile terminal device
an information transmitting/receiving unit that transmits external image information of the person to be diagnosed photographed by the camera and health information indicating the health condition of the person to be diagnosed to the health diagnosis device connected to a network;
The health checkup device
a diagnosis unit that diagnoses the health condition of the person to be diagnosed based on the appearance image information and the health information transmitted from the mobile terminal device;
A health checkup system, comprising: a notification unit that transmits information indicating a diagnosis result of the diagnosis to the mobile terminal device. 2. The diagnosis unit according to claim 1, wherein the diagnosis unit diagnoses the health condition of the person to be diagnosed by comparing the past appearance of the person to be diagnosed and the present appearance of the person to be diagnosed based on the appearance image information. Health checkup system. The health checkup device
further comprising a request unit for requesting the portable terminal device to further transmit the health information based on the diagnosis result by the diagnosis unit;
the information transmitting/receiving unit of the mobile terminal device, upon receiving the request from the health checkup device, transmits the health information to the health checkup device based on the request;
3. The diagnosis unit of the health diagnosis device according to claim 1, further using the health information transmitted from the mobile terminal device to diagnose the health condition of the person to be diagnosed. Health checkup system. The requesting unit of the health checkup device specifies a body part necessary for diagnosis based on the diagnosis result by the diagnosis unit, and uses the appearance image information showing the specified body part as the health information, make a request to the mobile terminal device,
When the information transmitting/receiving unit of the portable terminal device receives a request for the appearance image information showing the body part from the health checkup device, the information transmitting/receiving unit of the portable terminal device receives the image of the body part of the person to be diagnosed photographed by the camera. 4. The health checkup system according to claim 3, wherein appearance image information is transmitted to said health checkup device. the requesting unit of the health checkup device requests biometric information of the person to be diagnosed as the health information from the portable terminal device based on the diagnosis result by the diagnosis unit;
The mobile terminal device
further comprising a biometric information acquisition unit that acquires biometric information of the person to be diagnosed;
5. The information transmitting/receiving unit, when receiving the request for the biological information from the medical examination apparatus, transmits the biological information of the person to be diagnosed acquired by the biological information acquiring unit to the medical examination apparatus. Health screening system as described. When the request unit of the health checkup device determines that long-term observation of the person to be diagnosed is necessary based on the diagnosis result of the diagnosis unit, the mobile terminal device periodically transmits the health information. request for
4. The information transmitting/receiving unit of the portable terminal device according to claim 3, wherein upon receiving a periodic transmission request of the health information from the health checkup device, the information transmission/reception unit periodically sends the health information to the health checkup device. health check-up system. The portable terminal device acquires appearance image information of the person to be diagnosed photographed by the camera,
3. The information transmitting/receiving unit of the portable terminal device acquires the appearance image information in response to a request from the health diagnosis device, and transmits the acquired appearance image information to the health diagnosis device. A health checkup system according to claim 6 . The health checkup device further comprises a storage device for storing the appearance image information received from the mobile terminal device and the biological information received as the health information,
3. The notification unit of the health checkup device transmits the latest one of the appearance image information and the biometric information stored in the storage device to the portable terminal device at regular intervals. The image forming apparatus according to claim 7 .

Images