JP6821364B2 - Health management system and its programs - Google Patents

Description

The present invention relates to a health care system and its program.

Conventionally, Patent Document 1 discloses a system for performing health management at home during daily activities. The system of Patent Document 1 is provided with a computer and a display device on the vanity, measures the characteristics of body parts that reflect the user's health condition in the space of the vanity, the toilet, the bathroom, the bedroom, and the like, and measures the measurement data. It is analyzed and displayed on the above display device.

Further, Patent Document 2 is a system in which a urinalysis device, a blood flow test device, or the like is provided in a toilet to perform measurement and analysis at a medical institution, and biological information does not require a special time for examination. The system for management is disclosed.

Further, Patent Document 3 discloses a device that uses a mobile terminal provided with a camera and an image display device to take an image of the face and tongue to perform an accurate health condition inspection without a doctor.

JP-A-2002-83055 Japanese Unexamined Patent Publication No. 2000-232964 JP 2015-202208

In any of the above-mentioned Patent Documents 1 to 3, the health and illness information is not projected in the mirror in which the person is projected during the normal life in the house, but the display device is separately provided. I couldn't imagine what my face would look like in the future due to illness, so it wasn't always easy to use.

The present invention has been made in view of the problems provided by the conventional health management system as described above, and an object thereof is health based on a doctor's diagnosis in a mirror in which oneself is projected during a normal life in a residence. It is to provide a health management system in which illness information is projected and health illness information can be obtained naturally when looking at one's own mirror image. It is also to provide an easy-to-use health management system that allows you to imagine what your face will look like in the future due to illness.

The health management system according to the present invention is related to a camera that acquires image information by photographing a living body including a face from the outside, a biological information sensor that obtains biological information from the living body, and the health state and illness of the living body. An output means for displaying and / or printing out the image information and the biometric information so that the biometrics information can be acquired, and a doctor's diagnosis based on the biometric information of the image information and the biometric information output by the output means. Based on the input means for inputting the resulting health and illness information, the captured face image, and the input health and illness information, the face image creation that creates an augmented reality predicted face image corresponding to the health and illness information. Means and
A display means for displaying an image on a mirror surface, a display position control means for instructing a position for displaying the predicted face image, and a mirror image of the face projected on the mirror surface, and the predicted face image as an instruction of the display position control means. Based on the above, the display means is provided with a display control means for displaying.

In the health management system according to the present invention, the display position control means indicates a position to display the input health / disease information, and the display control means displays the health / disease information of the diagnosis result. It is characterized in that it is displayed on the display means based on the instruction of the position control means.

The health management system according to the present invention includes a face position detecting means for detecting a mirror image position of a face projected on the mirror surface, and the display position controlling means has the predicted face image and / / in relation to the mirror image position of the face. Alternatively, the position for displaying the health and illness information is instructed, and the display control means displays the predicted face image in association with the mirror image position of the face based on the instruction of the display position control means. And.

The health management system according to the present invention is characterized in that the display position control means controls to superimpose and display the predicted face image on the mirror image position of the face.

In the health management system according to the present invention, the biometric information sensor is at least one of a urinalysis device, a blood pressure heart rate sensor, and a body composition analyzer.

In the health management system according to the present invention, a biometrics information acquisition means for acquiring biometrics information related to a health condition and a disease using image information captured by the camera, and machine learning based on the acquired biometrics information. It is further provided with a health disease information derivation means for deriving health disease information by using a technique, and is characterized in that the health disease information derived by the health disease information derivation means is output from the output means.

In the health management system according to the present invention, the biometrics information acquisition means acquires at least one of skin color, skin condition, lip color, and eyeball color.

The program of the health management system according to the present invention includes a camera that captures an image of a living body including a face from the outside and acquires image information, a biological information sensor that obtains biological information from the living body, and the health condition and illness of the living body. An output means for displaying and / or printing out the image information and the biometric information so that the related biometrics information can be acquired, and a doctor based on the biometrics information of the image information and the biometric information output by the output means. It has an input means for inputting health and illness information which is the diagnosis result of the above, and a display means for displaying an image on the mirror surface, and the display means for displaying health management is performed. The computer of the management system displays the predicted face image, which is a face image creating means for creating an augmented reality predicted face image corresponding to the health and illness information based on the captured face image and the input health and illness information. It is characterized in that it functions as a display position control means for instructing a position and a display control means for displaying the predicted face image on the display means based on an instruction of the display position control means together with a mirror image of a face projected on the mirror surface.

In the program of the health management system according to the present invention, the display position control means is further made to function to indicate the position where the input health / illness information is displayed, and the display control means is further made to indicate the health of the diagnosis result. It is characterized in that the disease information is made to function to be displayed on the display means based on the instruction of the display position control means.

In the program of the health management system according to the present invention, the computer is further functioned as a face position detecting means for detecting the mirror image position of the face projected on the mirror surface, and the display position controlling means is further referred to as the mirror image position of the face. In relation to this, the predicted face image and / or the position for displaying the health / illness information is made to be instructed, and the display control means is further subjected to a mirror image of the predicted face image based on the instruction of the display position control means. It is characterized in that it functions to be displayed in association with a position.

The program of the health management system according to the present invention is characterized in that the display position control means is further made to function so as to superimpose the predicted face image on the mirror image position of the face.

In the program of the health management system according to the present invention, the biometric information sensor is at least one of a urinalysis device, a blood pressure heart rate sensor, and a body composition analyzer.

In the program of the health management system according to the present invention, the computer is further subjected to a biometrics information acquisition means for acquiring biometrics information related to a health condition and a disease by using image information captured by the camera, and the acquired biotechnology. It is characterized by functioning as a health disease information derivation means for deriving health disease information using machine learning technology based on metrics information, and outputting the health disease information derived by the health disease information derivation means from the output means. To do.

The program of the health management system according to the present invention is characterized in that the biometrics information acquisition means is further made to function to acquire at least one of skin color, skin condition, lip color, and eyeball color.

In the present invention, health and illness information is projected in a mirror that reflects oneself during a normal life in a house, and health and illness information can be naturally obtained when looking at one's own mirror image, which is convenient. ..

In the present invention, it is possible to imagine what one's face will look like in the future due to illness or the like, and it is easy to use and intuitively knows the health condition.

The block diagram which shows the 1st Embodiment of the health management system which concerns on this invention. The figure which shows the area of the wall thickness of a face applied in the process of creating the predicted face image created by the embodiment of the health management system which concerns on this invention. The figure which shows an example of the table used in the process of creating the predicted face image created by the embodiment of the health management system which concerns on this invention. The flowchart which shows the operation of the 1st Embodiment of the health management system which concerns on this invention. The figure which shows the 1st display example of the predicted face image and health illness information displayed by embodiment of the health management system which concerns on this invention. The figure which shows the 2nd display example of the predicted face image and the health illness information displayed by the embodiment of the health management system which concerns on this invention. The figure which shows the 3rd display example of the predicted face image and the health illness information displayed by the embodiment of the health management system which concerns on this invention. The block diagram which shows the 2nd Embodiment of the health management system which concerns on this invention. The flowchart which shows the operation of the 2nd Embodiment of the health management system which concerns on this invention.

Hereinafter, embodiments of the health management system and its program according to the present invention will be described with reference to the accompanying drawings. In each figure, the same components are designated by the same reference numerals and duplicate description will be omitted. FIG. 1 shows a block diagram of a first embodiment in the health management system according to the present invention. In this embodiment, the user's home 100 is provided with a local computer 10, the center 500 is provided with a center server 50, and a medical institution 700 such as a hospital or clinic is provided with a computer 70 for doctors. The local computer 10 is connected to the local communication device 40, the center server 50 is connected to the center communication device 60, and the doctor's computer 70 is connected to the communication device 90. The local communication device 40, the center communication device 60, and the communication device 90 are connected via the network 600. As a result, the local computer 10 and the center server 50 are configured to be able to send and receive information to each other, and the doctor's computer 70 and the center server 50 are configured to be able to send and receive information to and from each other. In the present embodiment, one user's home 100 and one medical institution 700 are shown, but the user's home 100 is usually plural, and the medical institution 700 may be plural, and a plurality of local computers. The configuration is such that 10 or a computer 70 for a doctor is connected to one or more center servers 50.

A display control unit 21 is connected to the local computer 10. The display control unit 21 functions as a display means for displaying an image on the display device 23 having the mirror surface 22 based on the image signal sent from the local computer 10. The display device 23 can see the image projected on the screen of the display device 23 when viewed from the surface of the mirror surface 22. Further, since the mirror surface 22 functions as a mirror that reflects the light incident from the front side thereof and forms a mirror image, the mirror image can be seen by the user A, and therefore, by the user A looking at the mirror surface 22. The image displayed on the screen of the display device 23 by the display control unit 21 and the mirror image of the user A reflected and imaged by the mirror surface 22 can be seen.

A camera 24 is provided in the center of the upper part of the mirror surface 22, for example, so that the front of the mirror surface 22 can be imaged. The camera 24 is provided with, for example, a motion sensor, and when a person arrives in front of the camera 24, the power is turned on by the motion sensor to automatically start imaging, and the image signal obtained by the imaging is sent to the local computer 10. Be done.

A touch panel 25 is provided on the surface of the mirror surface 22, and when the touch panel 25 is operated, the coordinate information is detected by the coordinate detecting means 15 of the local computer 10. The local computer 10 is further provided with a menu display corresponding processing means 16, and sends a menu image to the display control unit 21 to display the menu when necessary. Further, when the menu is selected by operating the touch panel 25, the menu display corresponding processing means 16 executes the processing of the selected menu. For example, the menu display corresponding processing means 16 switches the display of health and illness information, which will be described later.

In the present embodiment, the user's home 100 is provided with the biometric information sensor 30 as needed. When the biometric information sensor 30 detects a person by, for example, a motion sensor, the power is turned on to automatically perform measurement, and the biometric information obtained by the measurement is sent to the local computer 10. As the biological information sensor 30, a urinalysis device 31, a blood pressure / heart rate sensor 32, and a body weight / body tissue meter 33 may be provided. The urine test device 31 is provided in the toilet, automatically tests, and sends the result to the local computer 10. As the test item of the urine test device 31, any one or more of urine protein, urine sugar, urine urobilinogen, urine bilirubin, urine pH, urine occult blood reaction, urine ketone body, and urine sediment can be adopted.

The blood pressure heart rate sensor 32 can be installed in front of the mirror surface 22 and the display device 23. The test items of the blood pressure and heart rate sensor 32 can be blood pressure and pulse rate, but other than this, a sensor capable of measuring an electrocardiogram may be used. The body composition analyzer 33 can also be installed in front of the mirror surface 22 and the display device 23. The test items (parameters) of the body composition analyzer 33 can be body weight, body fat percentage, visceral fat level, body mass index (BMI), and the like.

As the biological information sensor 30, in addition to the above sensors, an electronic thermometer for measuring body temperature, an activity meter for measuring the number of steps, calories burned, and sleep time may be adopted. The electronic thermometer and the activity meter can be attached to the user's body, and the obtained information can be sent to the local computer 10 by wireless communication.

The image information obtained by the camera 24 and the biometric information obtained by the biometric information sensor 30 are sent to the center server 50 via the local communication device 40, the network 600, and the center communication device 60.

When a plurality of users use this system in the user's home 100, for signals and information from the camera 24, the urine test device 31, the blood pressure and heart rate sensor 32, and the body tissue meter 33, for example, a local computer 10 can be configured to include a biometrics authentication program such as palm vein recognition and face recognition, and to provide sensors such as a camera necessary for vein recognition and face recognition corresponding to each of the above sensors. Further, the electronic thermometer and the activity meter can be configured to add personal identification information when sending a signal or the like to the local computer 10.

The center server 50 is provided with a computer unit 51 and a large-capacity storage unit 52. The computer unit 51 is configured as a computer that performs required processing based on a program, and includes data storage / transmission control means 71 and face image creation means 74.

The data storage / transmission control means 71 stores the image information obtained by the camera 24 sent from the local computer 10 and the biometric information obtained by the biometric information sensor 30 in the storage unit 52 separately for each user. Further, the data storage control means 71 transmits the image information and the biological information stored in the storage unit 52 to the computer 70 of the medical institution 700 corresponding to the user.

The computer 70 includes an output means 82 composed of a CPU 81, a display device such as an LED connected to the CPU 81, and / or a printer, and an input means 83 connected to the CPU 81 such as a keyboard and a mouse that can input information. It has.

The CPU 81 receives the image information and the biological information sent from the center server 50 as described above, and sends and outputs the image information to the output means 82. The doctor visually observes the image information and the biological information output by the output means 82, makes a diagnosis based on the biometrics information related to the health condition and the disease, and derives the health condition information.

As for health disease information, "predictive signs of XX disease (disease)" can be "extremely slight", "presence", "high", and the like. In addition, it may be warning information such as "If you live as it is, you may get XX disease (disease)". This information can be input by the doctor by the input means 83. Further, it may be information indicating that parameters such as blood pressure, uric acid level, and BM1 are simply higher than normal values, and this information can be created by a doctor by activating the corresponding program of the computer 70. .. Further, the health and illness information can be a graph created by arranging some biological information obtained by the biological information sensor 30 over time, and this graph is also created by the doctor by activating the corresponding program of the computer 70. You may do so. The health and illness information input or obtained by the doctor is sent to the corresponding center server 50.

As described above, the computer unit 51 of the center server 50 is provided with the face image creating means 74. The face image creating means 74 creates an augmented reality predicted face image corresponding to the health and illness information based on the captured face image and the health and illness information input by the doctor. In order to create a predicted face image by the face image creating means 74, the storage unit 52 is provided with a parameter 530 for creating a predicted face image.

The prediction face image creation parameter 530 is, for example, a table in which the complexion is associated with the level of the disease name. As for the level of the disease name, when "the sign of XX disease (disease)" is "very slight", "yes", "high", etc., "very little" is level 1 and "yes" is level 1. 2. “High” is set to level 3, and colors are associated with each. This color is quantified by, for example, an LCh color system according to hue, lightness, and saturation, and can be converted into, for example, an RGB image signal based on these numerical values. Further, the parameter 530 for creating a predicted face image can divide the face into an upper part, a middle part, and a lower part as shown in FIG. 2, and represent the degree of swelling by the wall thickness from the initial (healthy state). .. FIG. 3 shows an example of a table of the predicted face image creation parameter 530 configured in this way. Of course, a more detailed simulation image may be created by increasing the number of levels and increasing the number of divisions of the facial part.

The predicted face image and the health / illness information created by the face image creating means 74 using the predicted face image creating parameter 530 are sent to the corresponding local computer 10. In the above, it was shown that the color of the entire face is changed depending on the level, but the face may be divided into areas as shown in FIG. 2 and the color of each area may be changed.

When health and illness information is sent from the center server 50 to the local computer 10, it receives it and further sends it to the display control unit 21. The display control unit 21 displays health and illness information on the display device 23.

The local computer 10 is provided with a display position control means 11 for instructing a position for displaying the predicted face image and a face position detection means 12. The face position detecting means 12 detects the mirror image position of the face projected on the mirror surface 22. Specifically, since the front of the mirror surface 22 is imaged by the camera 24 and the face of the user A can be imaged to obtain an image of the face, this face image is used. For example, the screen of the image captured by the camera 24 and the size of the mirror surface 22 are matched, and the center of the face image is set as the coordinates of the face position. The display position control means 11 instructs a position to display the predicted face image, and further instructs a position to display the derived health / illness information. The display position control means 11 indicates a position for displaying the predicted face image and / or the health / illness information in relation to the mirror image position of the face.

From the coordinates of the face position obtained as described above, the health / illness information and / or the predicted face image can be displayed right beside, for example, by the control of the display position control means 11. When the distance from the coordinates of the face position to the edge of the screen of the image device 23 in the right lateral direction is a distance that does not include health / illness information and / or the predicted face image, it is placed on the left side, and if necessary, either up or down. The predicted face image is controlled to be moved and displayed. The coordinates of the face position and the center of the predicted face image may be matched so that the predicted face image is superimposed on the mirror image position of the face and displayed.

Further, under the control of the display position control means 11, the health / illness information may be displayed at a predetermined position on the screen of the image device 23, or the health / illness information may be displayed in the vicinity of the position of the predicted face image. The health and illness information may be displayed at a position having a predetermined relationship, such as a position symmetrical with the position of the predicted face image.

The system configured as described above operates as shown in the flowchart shown in FIG. When the power is turned on, the biometric information sensor 30 automatically measures the biometric information and sends the biometric information obtained by the measurement to the local computer 10 (S11). Further, the power is turned on, the camera 24 automatically starts imaging, and the image signal obtained by the imaging is sent to the local computer 10 (S12).

The biological information and image information received by the local computer 10 in steps S11 and S12 are transmitted from the local computer 10 to the center server 50 (S13). In this case, the biological information and the image information may be encrypted and transmitted.

The center server 50 receives the transmitted biological information and image information, decrypts the transmitted biological information and image information when it is encrypted, and stores the biological information and image information in the storage unit 52 (S14). Needless to say, when a plurality of users use this system, the unit of transmission / reception and the unit of storage are performed for each user.

The biological information and image information (image information obtained by photographing the living body including the face from the outside) that arrived and are stored as described above are sent to the computer 70 for doctors and output from the output means 82 of the computer 70 (S15). A doctor makes a diagnosis based on the output biological information and image information, obtains health and illness information, inputs the health and illness information using the input means 82, and transmits the health and illness information to the center server 50 (S16).

Based on the captured face image and the health and illness information that is the diagnosis result of the doctor sent in step S16, an augmented reality predicted face image corresponding to the health and illness information is created and transmitted to the local computer 10 (S17). ).

The local computer 10 creates a position for displaying the coming predicted face image and health / illness information, that is, display position information (coordinates) for displaying the predicted face image and health / illness information on the screen of the display device 23. (S18). The display position may be provided in advance. When the predicted face image and health / illness information arrive, the local computer 10 sends the predicted face image and health / illness information to the display control unit 21 together with the display position information, and displays the predicted face image and health / illness information on the screen of the display device 23. Displayed above (S19).

FIG. 5 shows an example of the predicted face image and health / illness information displayed on the screen of the display device 23 as described above. Reference numeral 101 denotes a mirror image of the face of the user A projected by the mirror surface 22. A predicted face image 102 is displayed at a predetermined position from the mirror image 101.

Further, as health and illness information, a graph 103 created by arranging some biological information over time is displayed on the left side of the screen. This graph 103 is a graph of changes over time in body weight (Kg), BMI, and uric acid level (mg / dL).

Further, on the right side of the predicted face image 102, health disease information 104 stating that there is a sign of diabetes and health disease information 105 and 106 indicating that the parameters BM1 and uric acid level are simply higher than the normal values are displayed. Has been done.

In the present embodiment, the face position detecting means 12 is provided, and the display position controlling means 11 indicates a position for displaying the predicted face image and / or health / disease information in relation to the mirror image position of the face. Therefore, it is assumed that the user A moves from the position of the face mirror image 101 shown in FIG. 5 and the face mirror image 101 is displayed at the position shown in FIG.

Then, the position (coordinates) of the face detected by the face position detecting means 12 is changed, the position (coordinates) of the face is changed, and the display position controlling means 11 is set to the mirror image position (101 in FIG. 6) of the face. In this relationship, the position where the predicted face image 102 and / or the health / illness information (graph 103) is displayed is indicated.

That is, the display position control means 11 can detect the position and size of the current face (display path in FIG. 6) from the image obtained by the camera 24, and the predicted face image 102 having the size shown in FIG. 5 is used as the face. It is detected that the overlapping health and illness information is the graph 103 when the mirror image 101 of the above is followed. Therefore, along with an instruction to make the predicted face image 102 follow the mirror image 101 of the face, an instruction to move the graph 103 to a position not overlapping with other images and display the graph 103 is sent to the display control unit 20. As a result, the display on the screen of the display device 23 is switched as shown in FIG.

FIG. 7 shows another display example of the predicted face image displayed on the screen of the display device 23 and the health / illness information. This display example is an example in which the predicted face image 102 is completely superimposed on the mirror image 101 of the face. Here, for example, since the user does not see any signs of illness, the size of the mirror image 101 of the face and the size of the predicted face image 102 are substantially equal, and the images are viewed as one image. Health and illness information 108 and 109 indicating that the parameters are simply higher than the normal values are displayed.

When the user A moves and the position of the mirror image 101 of the face moves while the display as shown in FIG. 7 is displayed, the predicted face image 102 becomes the mirror image 101 of the face as described in FIG. It is moved and displayed following it.

Further, in the example of FIG. 7, the "menu display" instruction key 110 is displayed at the lower right of the screen. When the touch panel 25 of the "menu display" instruction key 110 is operated, the menu is displayed. The menu can include switching the contents of the graph 103, switching parameters of health and illness information indicating that the values are simply higher than the normal values, and canceling the display of the predicted face image 102. In response to this, the menu display corresponding processing means 16 requests the center server 50 for a graph other than the contents of the graph 103, and controls so that the graph is displayed when it is sent. Further, the center server 50 is requested to receive health disease information other than the health disease information indicating that the value is simply higher than the normal value being displayed, and control is performed so that this is displayed when sent.

Further, as a menu, the degree of overlap and the distance between the predicted face image 102 and the mirror image 101 of the face may be displayed as a menu. Further, the predicted face image 102 and / or the display position of the health / illness information may be displayed as a menu.

In the present embodiment, the touch panel 25 is used as the input means, but a microphone is provided on the mirror surface 22 to input voice, and the local computer 10 is provided with a voice recognition function, and the recognition result is the same as the menu display compatible processing means 16. The processing may be performed by giving it to the means for performing the function of. Further, a means for capturing a gesture or body action by the user A with the camera 24 and using it as an input means, equipping the local computer 10 with a video recognition function, and performing the recognition result in the same function as the menu display corresponding processing means 16. You may perform processing by giving to.

Biometrics information related to health condition and illness is acquired using image information obtained by imaging the living body including the face from the outside, and based on the acquired biometrics information, health illness information is derived using machine learning technology and imaged. Based on the obtained face image and the above health and illness information, an augmented reality predicted face image corresponding to the health and illness information is created, and the predicted face image is displayed together with the mirror image of the face projected on the mirror surface. Can be known.

Next, the second embodiment will be described. The system according to the second embodiment is configured as shown in FIG. That is, the computer unit 51 of the center server is provided with the biometrics information acquisition means 72 and the health / disease information derivation means 73 in addition to the data storage control means 71 and the face image creation means 74 provided in the first embodiment. ..

The biometrics information acquisition means 72 acquires biometrics information related to a health condition and a disease by using image information obtained by photographing a living body including a face from the outside. In this embodiment, the skin color, lip color, and eyeball color of the face are acquired (extracted) as biometrics information. In addition, the area of the face (change), the thickness and color of the neck and limbs (change), and the like may be acquired as biometrics information. For the color of the face, lips, and other biological parts, the color of some points may be obtained, or the average of some points may be obtained.

The health / disease information derivation means 73 derives health / disease information using machine learning technology based on the biometrics information acquired by the biometrics information acquisition means 72. The health / disease information derivation means 73 derives health / disease information using the machine learning technology algorithm 520 stored in the storage unit 52. The machine learning technology algorithm 520 includes correspondence data in which the color of the biological part and the health / disease information are associated with each other. Based on the color of the living body part obtained as described above, it is possible to search the corresponding data and derive health / disease information. As the machine learning technology algorithm 520, a random forest or the port vector machine can be adopted.

The health illness information obtained by the health illness information derivation means 73 can have "very slight signs of XX disease (disease)", "presence", "high", and the like. In addition, it may be warning information such as "If you live as it is, you may get XX disease (disease)". Further, it may be information indicating that parameters such as blood pressure, uric acid level, and BM1 are simply higher than normal values. Further, the health / illness information can be a graph created by arranging some biological information obtained by the biological information sensor 30 over time. The health illness information obtained by the health illness information derivation means 73 is sent to the computer 70 for the doctor concerned together with the image information and the biological information captured by the camera.

The CPU 81 of the computer 70 receives the image information, the biological information, and the health / illness information sent from the center server 50 as described above, and sends and outputs the information to the output means 82. The doctor visually observes the image information and biological information output by the output means 82 and the health and illness information by the machine learning technology algorithm 520, and based on these, makes a diagnosis based on the biometrics information related to the health condition and the illness, and as a doctor. Derivation of health and illness information, which is the diagnosis result of. The health and illness information, which is the result of the diagnosis as a doctor, is input by the doctor from the input means 83. The input health and illness information, which is the diagnosis result as a doctor, is sent to the computer unit 51 of the center server 50.

In the computer unit 51, the face image creating means 74 predicts augmented reality corresponding to the health and illness information based on the captured face image and the health and illness information which is the diagnosis result as a doctor sent from the computer 70 by the above. It creates a face image. Subsequent processing is the same as that of the first embodiment.

The system according to the second embodiment configured as described above operates as shown in the flowchart shown in FIG. From step S11 to step S14, the same processing as in the first embodiment is performed. The computer unit 51 (biometrics information acquisition means 72) is in a healthy state by using the biological information and the image information (image information obtained by photographing the living body including the face from the outside) that arrived in the storage unit 52 as described above. And the biometrics information related to the disease is acquired (S21).

Further, the computer unit 51 derives health and illness information by using machine learning technology based on the biometrics information acquired above, and captures the health and illness information as biological information and image information (a living body including a face is imaged from the outside). It is transmitted to the computer 70 for doctors together with the image information), and is output from the output means 82 of the computer 70 (S22). Based on the output biological information and image information, the doctor makes a diagnosis by referring to the health and illness information by machine learning, obtains the health and illness information, and inputs this health and illness information using the input means 82. , Sent to the center server 50 (S23). After that, the processes of steps S17 to S19 of the first embodiment are performed.

The display example of the predicted face image and the health / illness information displayed on the screen of the display device 23 according to the second embodiment is as shown in FIGS. 5, 6 and 7 as in the first embodiment. .. According to the present embodiment, since the health and illness information by machine learning is shown to the doctor, the doctor can create the health and illness information by adding the diagnosis as a doctor while referring to this, and more accurate health and illness information. Can be expected to be obtained.

In the present embodiment, the health / illness information deriving means 73 may be provided with a learning function, and the machine learning technology algorithm 520 may be changed based on the health / illness information diagnosed by a doctor. With this configuration, the accuracy of derivation of health and illness information by the health and illness information derivation means 73 can be improved, and in the present embodiment, the predicted face image is directly transmitted to the local computer 10, but it is created. The predicted face image may be first sent to the computer 70 for doctors and output, and after confirmation by the doctor, only the predicted face image approved by the doctor may be transmitted to the local computer 10. In addition to being confirmed by a doctor, the doctor's computer 70 is provided with a program for changing the predicted face image, the complexion and the degree of swelling of the face are changed, and the changed predicted face image is displayed on the local computer 10. You may send it to. Further, the result of changing the predicted face image by the computer 70 for a doctor may be fed back to the face image creating means 74 to change the predicted face image creating parameter 530 and the like.

10 Local computer 11 Display position control means 12 Face position detection means 15 Coordinate detection means 16 Menu display support processing means 21 Display control unit 22 Mirror surface 23 Display device 24 Camera 25 Touch panel 30 Biological information sensor 31 Urine test device 32 Blood pressure heart rate sensor 33 Weight Body tissue total 40 Local communication device 50 Center server 51 Computer unit 52 Storage unit 60 Center communication device 71 Data storage control means 72 Biometrics information acquisition means 73 Health and illness information derivation means 74 Face image creation means 81 CPU
82 Output means 83 Input means 90 Communication device 100 User's house 101 Mirror image 102 Predictive face image 103 Graph 104, 105, 108, 109 Health and illness information 110 Instruction key 500 Center 520 Machine learning technology Algorithm 530 Predictive face image creation parameter 600 Network 700 medical institutions

Claims (14)

A camera that captures the living body including the face from the outside and acquires image information,
A biological information sensor that obtains biological information from the living body,
An output means for displaying and / or printing out the image information and the biological information so that biometrics information related to the health condition and the disease of the living body can be acquired.
An input means for inputting health and illness information which is a diagnosis result of a doctor based on the biometric information of the image information and biological information output by the output means, and
A face image creating means for creating an augmented reality predicted face image corresponding to the health and illness information based on the captured face image and the input health and illness information.
Display means for displaying images on a mirror surface,
A display position control means for instructing a position to display the predicted face image and a display control means for displaying the predicted face image on the display means based on the instruction of the display position control means together with a mirror image of the face projected on the mirror surface. A health management system characterized by having. The display position control means indicates a position for displaying the input health / illness information.
The health management system according to claim 1, wherein the display control means displays the health and illness information of the diagnosis result on the display means based on the instruction of the display position control means. A face position detecting means for detecting a mirror image position of a face projected on the mirror surface is provided.
The display position control means indicates a position for displaying the predicted face image and / or the health / illness information in relation to the mirror image position of the face.
The health management system according to claim 2, wherein the display control means displays the predicted face image in association with a mirror image position of the face based on the instruction of the display position control means. The health management system according to claim 3, wherein the display position control means controls to superimpose and display the predicted face image on a mirror image position of the face. The health management system according to any one of claims 1 to 4, wherein the biological information sensor is at least one of a urinalysis device, a blood pressure heart rate sensor, and a body composition analyzer. Biometrics information acquisition means for acquiring biometrics information related to health condition and illness using image information captured by the camera, and
Health and illness information derivation means for deriving health and illness information using machine learning technology based on the acquired biometrics information,
Further equipped,
The health management system according to any one of claims 1 to 5, wherein the health / illness information derived by the health / illness information deriving means is output from the output means. The health management system according to claim 6, wherein the biometrics information acquisition means acquires at least one of skin color, skin condition, lip color, and eyeball color. A camera that acquires image information by imaging a living body including a face from the outside, a biological information sensor that obtains biological information from the living body, and biometrics information related to the health condition and illness of the living body can be acquired. Input the output means for displaying and / or printing out the image information and the biological information, and the health and illness information which is the diagnosis result of the doctor based on the biometric information of the image information and the biological information output by the output means. A computer of a health management system that has an input means for, has a mirror surface, and has a display means for displaying an image on the mirror surface, and displays health management on the display means.
A face image creating means for creating an augmented reality predicted face image corresponding to the health and illness information based on the captured face image and the input health and illness information.
Display position control means for instructing a position for displaying the predicted face image,
A program of a health management system characterized in that the predicted face image is made to function as a display control means to be displayed on the display means based on an instruction of the display position control means together with a mirror image of the face projected on the mirror surface. The display position control means is further made to function to indicate a position for displaying the input health / illness information.
The program of the health management system according to claim 8 , wherein the display control means further functions to display the health and illness information of the diagnosis result on the display means based on the instruction of the display position control means. .. Further computer
It functions as a face position detecting means for detecting the mirror image position of the face projected on the mirror surface.
The display position control means is further made to function to indicate a position for displaying the predicted face image and / or the health / illness information in relation to the mirror image position of the face.
The health management system according to claim 9, wherein the display control means further functions to display the predicted face image in association with a mirror image position of the face based on the instruction of the display position control means. Program. The program of the health management system according to claim 10, wherein the display position control means further functions to display the predicted face image on a mirror image position of the face. The program of the health management system according to claim 11 , wherein the biometric information sensor is at least one of a urinalysis device, a blood pressure heart rate sensor, and a body composition analyzer. Further, the computer
A biometrics information acquisition means for acquiring biometrics information related to a health condition and a disease using image information captured by the camera.
Health and illness information derivation means for deriving health and illness information using machine learning technology based on the acquired biometrics information,
To function as
The program of the health management system according to any one of claims 8 to 12, wherein the health and illness information derived by the health and illness information deriving means is output from the output means. The program of the health management system according to claim 13, wherein the biometrics information acquisition means is further made to function to acquire at least one of skin color, skin condition, lip color, and eyeball color.

Images