JP7056008B2 - Physical condition analyzer and the program - Google Patents

Description

The present invention relates to a physical condition analyzer and a physical condition analysis program for analyzing a physical condition.

People want to be healthy every day, but in order to manage their physical condition, they often have to measure it with a dedicated measuring device, such as a sphygmomanometer that measures blood pressure, which is one of the indicators. For this reason, people dislike the trouble and do not measure or forget about it. Therefore, Patent Document 1 proposes a health management system.

The health management system disclosed in Patent Document 1 includes a mirror portion provided on a dressing table or a washbasin, a face image information acquisition means for acquiring face image information of a user who uses the mirror portion, and an acquired face. It includes an analysis unit that analyzes the skin condition of the user's face from image information, and an analysis result notification means that notifies the analysis result by the analysis unit. According to this, the mirror provided on the dressing table or washbasin, which is looked into when preparing to go out in the morning, is used as a mirror part for acquiring facial image information by the facial image information acquisition means. You can check your health regularly and improve your health (for example, paragraph [0005]). The health management system disclosed in Patent Document 1 has an acquired information storage unit that stores facial image information acquired by the facial image information acquisition means, and a facial image that displays facial image information stored in the acquired information storage unit. Further, a display means and a control unit that displays the face image information stored in the acquired information storage unit when the judgment result by the determination unit is low evaluation in the face image display means when the judgment result is high evaluation. Be prepared. According to this, when a low evaluation judgment result by the judgment unit is notified to the user by the judgment result notification means and the user is depressed, the control unit obtains information when the judgment result is high evaluation. By displaying the face image information stored in the storage unit on the face image display means, it is possible to encourage the user and promote health (for example, paragraph [0008]).

Japanese Unexamined Patent Publication No. 2009-15369

By the way, since the number of users looking into the mirror portion is not necessarily one if there are cohabitants, for example, the health management system disclosed in Patent Document 1 may have data of a plurality of people mixed. .. If the data of multiple people are mixed, the physical condition of each person cannot be analyzed properly.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a physical condition analyzer and a physical condition analysis program capable of more appropriately analyzing a physical condition.

As a result of various studies, the present inventor has found that the above object can be achieved by the following invention. That is, the physical condition analysis device according to one aspect of the present invention includes a mirror, an image pickup unit that captures an image in front of the mirror and generates an image as an analysis target image, and a user identification for identifying and identifying the user. An identification information storage unit that stores information, a user determination unit that determines whether or not the user identification information stored in the identification information storage unit is a user based on an analysis target image captured by the imaging unit, and a user determination unit. A reference feature amount storage unit that stores the feature amount, which is a predetermined feature amount used for pathological diagnosis in the user and is a judgment standard when analyzing a physical condition, as a judgment reference feature amount, and an image pickup unit. When the user is determined to be the user of the feature amount processing unit that obtains the feature amount as the feature amount at the time of analysis from the analyzed image and the user identification information stored in the identification information storage unit by the user determination unit. In addition, the determination reference feature amount stored in the reference feature amount storage unit and the analysis-time feature amount obtained by the feature amount processing unit in the user of the user identification information determined by the user determination unit. Based on the above, an analysis unit that analyzes the physical condition and an output unit that outputs the analysis result of the physical condition analyzed by the analysis unit to the outside are provided. Preferably, in the above-mentioned physical condition analyzer, the reference feature amount storage unit stores one or more of the determination reference feature amounts in association with one or more of the user identification information. Preferably, in the above-mentioned physical condition analyzer, the identification information storage unit stores one or a plurality of the user identification information in association with one or a plurality of users, and the reference feature amount storage unit has one. Alternatively, a plurality of the determination reference feature amounts are stored in association with one or a plurality of the users. Preferably, in the above-mentioned physical condition analyzer, a plurality of the feature quantities are obtained from the plurality of analysis target images captured by the image pickup unit, and the average value of the obtained plurality of feature quantities is obtained as the determination reference feature quantity. Further, a determination reference feature amount generation unit for storing the obtained determination reference feature amount in the reference feature amount storage unit is further provided. Preferably, in the above-mentioned physical condition analyzer, the feature amount includes a first feature amount and a second feature amount which is a component of the first feature amount. Preferably, in the above-mentioned physical condition analyzer, the first feature amount is the color of the white eye portion (white portion in the eyeball, conjunctival portion). Preferably, in the above-mentioned physical condition analyzer, the second feature amount is a blue component (blue component of hue) in the color of the white of the eye portion because the possibility of jaundice can be suitably analyzed. Preferably, in the above-mentioned physical condition analyzer, the second feature amount is a red component (red component of hue) in the color of the white of the eye portion because the possibility of conjunctivitis can be suitably analyzed. Preferably, at least one of cataracts and winglets, and at least one of retinal hemorrhage, retinal pigment degeneration, retinal choroidal atrophy, retinal choroiditis, optic nerve atrophy and optic nerve inflammation. In the above-mentioned physical condition analyzer, the second feature amount is the lightness in the color of the optic nerve portion (the portion of the retina and the pupil in the optic nerve) because it can be suitably analyzed. Preferably, in the above-mentioned physical condition analyzer, the second feature amount is the color of the cheek portion. Preferably, in the above-mentioned physical condition analyzer, the second feature amount is a blue component (blue component of hue) in the color of the cheek portion because the possibility of jaundice can be suitably analyzed. Preferably, in the above-mentioned physical condition analyzer, the second feature amount is the lightness in the color of the cheek portion because the possibility of kidney disease can be suitably analyzed. Preferably, in the above-mentioned physical condition analyzer, the feature amount is the eye level position because the possibility of osteoporosis can be suitably analyzed. Preferably, the above-mentioned physical condition analyzer further includes a reference color storage unit for storing a reference color as a reference, and the feature amount processing unit obtains the feature amount from the analysis target image captured by the image pickup unit. The corrected feature amount obtained by correcting the obtained feature amount based on the reference color stored in the reference color storage unit is obtained as the feature amount at the time of analysis.

Such a physical condition analysis device includes a mirror, generates an analysis target image by imaging the front of the mirror, and uses the user identification information stored in the identification information storage unit based on the analysis target image. When it is determined whether or not the user is a person, and as a result of this determination, it is determined that the user is the user of the user identification information stored in the identification information storage unit, the user of the determined user identification information is determined. The physical condition is analyzed based on the determination reference feature amount and the analysis feature amount obtained based on the analysis target image, and the analysis result is output to the outside. Therefore, the physical condition analyzer is provided with a mirror and generates an image to be analyzed by imaging the front of the mirror. Therefore, for example, face washing, tooth brushing, make-up, hair set, attachment of contact lens, removal thereof, etc. You can analyze your physical condition without being conscious of the natural movement of looking at the mirror in your daily life, and by referring to the output of the analysis result, you can see the daily physical condition during the natural movement. Can be checked. Then, the physical condition analysis device determines whether or not the user is the user of the user identification information stored in the identification information storage unit when analyzing the physical condition, and uses the determined user identification information. Since the physical condition is analyzed based on the judgment standard feature amount and the characteristic amount at the time of analysis in the person, even when the physical condition analyzer is used by a plurality of users, the judgment standard feature amount of the user is used. Since the physical condition is analyzed, the physical condition can be analyzed more appropriately.

Then , in the above-mentioned physical condition analysis device, the user identification information is a face image in which the user's face is imprinted, and the user determination unit is analyzed by the image pickup unit by the face authentication technique. Based on the target image, it is determined whether or not the user is the user of the user identification information stored in the identification information storage unit, and the user determination unit determines whether or not the user is the user of the user identification information stored in the identification information storage unit. When it is determined to be, the user identification information stored in the identification information storage unit of the user of the user identification information determined by the user determination unit is imaged by the image pickup unit. Further, an identification information update unit is further provided, which is updated based on the analysis target image and stored in the identification information storage unit.

Such a physical condition analysis device updates the user identification information stored in the identification information storage unit based on the analysis target image captured by the imaging unit and stores it in the identification information storage unit. Even if the appearance changes, the user can be determined more appropriately. Therefore, since the physical condition is analyzed by the determination reference feature amount of the user, the physical condition analyzer can analyze the physical condition more appropriately.

The physical condition analysis device according to another aspect of the present invention includes a mirror, an image pickup unit that captures an image in front of the mirror and generates an image as an analysis target image, and a user identification for identifying and identifying the user. An identification information storage unit that stores information, a user determination unit that determines whether or not the user identification information stored in the identification information storage unit is a user based on an analysis target image captured by the imaging unit, and a user determination unit. A reference feature amount storage unit that stores the feature amount, which is a predetermined feature amount used for pathological diagnosis in the user and is a judgment standard when analyzing a physical condition, as a judgment reference feature amount, and an image pickup unit. When the user is determined to be the user of the feature amount processing unit that obtains the feature amount as the feature amount at the time of analysis from the analyzed image and the user identification information stored in the identification information storage unit by the user determination unit. In addition, the determination reference feature amount stored in the reference feature amount storage unit and the analysis-time feature amount obtained by the feature amount processing unit in the user of the user identification information determined by the user determination unit. Based on the above, an analysis unit that analyzes the physical condition and an output unit that outputs the analysis result of the physical condition analyzed by the analysis unit to the outside are provided, and a determination threshold value used for the analysis of the physical condition by the user is provided. The analysis unit further includes a threshold storage unit for storing the above, and the analysis unit obtains the difference between the determination reference feature amount stored in the reference feature amount storage unit and the analysis-time feature amount obtained by the feature amount processing unit. The physical condition is analyzed by comparing the obtained difference with the determination threshold value stored in the threshold value storage unit in the user of the user identification information determined by the user determination unit.

Such a physical condition analysis device stores a determination threshold value used for analysis of the physical condition of the user, and analyzes the physical condition with the determination threshold value of the user. Therefore, the physical condition analyzer can customize the determination threshold value according to each user, and can analyze the physical condition more appropriately.

In another aspect, in the above-mentioned physical condition analyzer, the analysis unit determines whether or not the characteristic amount at the time of analysis obtained by the feature amount processing unit is within a predetermined normal range. At least one of the electronic medical record information indicating the contents of the medical record in the user and the health examination result information indicating the result of the health examination in the user by determining whether or not the physical condition is normal. In the past physical condition information storage unit that stores the past physical condition information as the past physical condition information and the past physical condition information stored in the past physical condition information storage unit in the user of the user identification information determined by the user determination unit. Based on this, the normal range adjusting unit for adjusting the normal range is further provided.

Such a physical condition analyzer adjusts the normal range based on the past physical condition information of the user of the user identification information determined by the user determination unit. Therefore, the physical condition analyzer can more appropriately determine whether or not the user is within the normal range by considering the past physical condition information of each individual user.

In another aspect, in the above-mentioned physical condition analyzer, the feature amount includes a first feature amount and a second feature amount which is a component of the first feature amount, and the feature amount processing unit is the feature amount processing unit. The first and second feature amounts are obtained as the first and second feature amounts at the time of analysis, respectively, and the analysis unit has the feature amount at the time of the first analysis obtained by the feature amount processing unit within a predetermined normal range. By determining whether or not it is, it is determined whether or not the physical condition is normal, and when the analysis unit determines that it is not within the normal range, it is stored in the reference feature amount storage unit. The difference between the determination reference feature amount and the feature amount at the time of the second analysis obtained by the feature amount processing unit is obtained, and the obtained difference and the user identification information determined by the user determination unit are used by the user. , The physical condition is analyzed by comparing with the determination threshold stored in the threshold storage unit.

Such a physical condition analyzer determines whether or not the user is within the normal range, and then analyzes the physical condition when the user is not within the normal range. Therefore, the physical condition analyzer can skip the process of analyzing the physical condition when it is within the normal range, while the physical condition is analyzed in two stages, so that the physical condition can be analyzed more appropriately.

The physical condition analysis program according to another aspect of the present invention is stored in an identification information storage unit that stores user identification information for identifying and identifying a user based on an image to be analyzed captured by a computer. A user determination step of determining whether or not the user identification information is a user, a feature amount processing step of obtaining a predetermined feature amount to be used for pathological diagnosis as a feature amount at the time of analysis from the analysis target image, and a feature amount processing step. When it is determined in the user determination step that the user is the user of the user identification information stored in the identification information storage unit, the body of the user of the user identification information determined in the user determination step. The reference feature amount stored in the reference feature amount storage unit that stores the feature amount as the judgment standard when analyzing the state, and the feature amount at the time of analysis obtained in the feature amount processing step. A physical condition analysis program for executing an analysis step of analyzing a physical condition and an output step of outputting the analysis result of the physical condition analyzed in the analysis step to the outside based on the above. The identification information is a face image in which the face of the user is imprinted, and the user determination step is a user identification stored in the identification information storage unit based on the analysis target image by the face authentication technique. When it is determined whether or not the information is a user and it is determined in the user determination step that the user is the user of the user identification information stored in the identification information storage unit, the determination is made in the user determination step . The identification information updating step of updating the user identification information stored in the identification information storage unit in the user of the user identification information based on the analysis target image and storing it in the identification information storage unit. It is a physical condition analysis program that further prepares. In such a physical condition analysis program, an image pickup unit provided on the mirror generates an analysis target image by imaging the front of the mirror, and the analysis target image is stored in the identification information storage unit based on the analysis target image. It is determined whether or not the user is a user of the user identification information, and as a result of this determination, when it is determined that the user is the user of the user identification information stored in the identification information storage unit, the determined user identification is performed. The physical condition of the information user is analyzed based on the determination standard feature amount and the analysis feature amount obtained based on the analysis target image, and the analysis result is output to the outside. Therefore, in the physical condition analysis program, the image pickup unit provided on the mirror generates an image to be analyzed by imaging the front of the mirror, so that the natural movement of looking at the mirror in the behavior in daily life is performed. The physical condition can be analyzed without being conscious of the situation, and by referring to the output of the analysis result, the daily physical condition can be checked during the natural movement. Then, the physical condition analysis program determines whether or not the user is the user of the user identification information stored in the identification information storage unit when analyzing the physical condition, and uses the determined user identification information. Since the physical condition is analyzed based on the judgment standard feature amount and the feature amount at the time of analysis in the person, even when the mirror is used by a plurality of users, the physical condition is determined by the judgment standard feature amount of the user. Since it is analyzed, the physical condition can be analyzed more appropriately. Further, such a physical condition analysis program is used because the user identification information stored in the identification information storage unit is updated based on the analysis target image captured by the imaging unit and stored in the identification information storage unit. Even if the person's appearance changes, the user can be determined more appropriately. Therefore, since the physical condition is analyzed by the determination reference feature amount of the user, the physical condition analysis program can analyze the physical condition more appropriately.

The physical condition analysis program according to another aspect of the present invention is stored in an identification information storage unit that stores user identification information for identifying and identifying a user based on an image to be analyzed captured by a computer. A user determination step of determining whether or not the user identification information is a user, a feature amount processing step of obtaining a predetermined feature amount to be used for pathological diagnosis as a feature amount at the time of analysis from the analysis target image, and a feature amount processing step. When it is determined in the user determination step that the user is the user of the user identification information stored in the identification information storage unit, the body of the user of the user identification information determined in the user determination step. The reference feature amount stored in the reference feature amount storage unit that stores the feature amount as the judgment standard when analyzing the state, and the feature amount at the time of analysis obtained in the feature amount processing step. Based on the above, it is a physical condition analysis program for executing an analysis step of analyzing a physical condition and an output step of outputting the analysis result of the physical condition analyzed in the analysis step to the outside, and is the analysis step. Obtained the difference between the determination reference feature amount stored in the reference feature amount storage unit and the feature amount at the time of analysis obtained in the feature amount processing step, and the determined difference was determined by the user determination step. It is a physical condition analysis program that analyzes a physical condition by comparing with a determination threshold used for analyzing the physical condition stored in the threshold storage unit in the user of the user identification information. Such a physical condition analysis program stores a determination threshold value used for analysis of the physical condition of the user, and analyzes the physical condition with the determination threshold value of the user. Therefore, the physical condition analysis program can customize the determination threshold value according to each user, and can analyze the physical condition more appropriately.

The physical condition analyzer and the physical condition analysis method according to the present invention can analyze the physical condition more appropriately.

It is a block diagram which shows the structure of the physical condition analysis apparatus in embodiment. It is a figure which shows the appearance structure of the physical condition analyzer. It is a figure which shows the structure of the base information table stored in the physical condition analyzer. It is a figure which shows the structure of the physical condition analysis system provided with the physical condition analysis apparatus. It is a flowchart which shows the operation of the physical condition analyzer. It is a flowchart which shows each process in the user identification process in the flowchart shown in FIG. 6 is a flowchart showing each process in various processes of the user's past physical condition information in the flowchart shown in FIG. 6 is a flowchart showing each process in the feature amount extraction process in the flowchart shown in FIG. In the analysis process of the flowchart shown in FIG. 5, it is a flowchart showing each process of the analysis process based on the black eye portion. In the analysis process of the flowchart shown in FIG. 5, it is a flowchart showing each process of the analysis process based on the white eye portion. In the analysis process of the flowchart shown in FIG. 5, it is a flowchart showing each process of the analysis process based on the cheek portion. It is a flowchart which shows each process in the process of the analysis result in the flowchart shown in FIG.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings. It should be noted that the configurations with the same reference numerals in the respective drawings indicate the same configurations, and the description thereof will be omitted as appropriate. In the present specification, when they are generically referred to, they are indicated by reference numerals without subscripts, and when they refer to individual configurations, they are indicated by reference numerals with subscripts.

FIG. 1 is a block diagram showing a configuration of a physical condition analyzer according to an embodiment. FIG. 2 is a diagram showing an external configuration of the physical condition analyzer. FIG. 3 is a diagram showing a configuration of a base information table stored in the physical condition analyzer. FIG. 4 is a diagram showing a configuration of a physical condition analysis system including the physical condition analysis device.

The physical condition analysis device in the embodiment is a device for analyzing the physical condition of the user, for example, as shown in FIGS. 1 and 2, the mirror 1 and the lighting unit 2 (2-1 and 2-2). It includes an image pickup unit 3, a display unit 4, a control processing unit 5, a storage unit 6, a communication interface unit (communication IF unit) 7, and a housing FR.

The housing FR is a member that houses the mirror 1, the image pickup unit 3, the display unit 4, the control processing unit 5, the storage unit 6, and the communication IF unit 7 so that the mirror 1 faces the outside. For example, the housing FR is relatively thin. It is a box body. The lighting unit 2 is arranged on the outer surface of the housing FR, as will be described later. The housing FR may be, for example, a single body constituting a hand mirror, a full-length mirror, or the like, or may be a part of, for example, a dressing table or a washbasin.

The mirror 1 is a member that captures the appearance of an object. In the present embodiment, in order for the image pickup unit 3 to image the front of the mirror 1 via the mirror 1 and the display content displayed on the display unit 4 via the mirror 1 to be referred to from the outside, the mirror 1 is used. , It is composed of a half mirror (semi-transmissive mirror). The ratio of the transmittance to the reflectance of the mirror 1 may be 1: 1, but it does not necessarily have to be 1: 1 and is arbitrary.

The illumination unit 2 is a light source device that is connected to the control processing unit 5 and emits illumination light that illuminates the front of the mirror 1 under the control of the control processing unit 5. The number of lighting units 2 may be one, but in the present embodiment, a person who uses the mirror 1 (the physical condition analysis device) for an image (analysis target image) generated by imaging the front of the mirror 1 with the image pickup unit 3. In order to suppress the formation of shadows on the image of the person when a user registered in D and a user who is not registered) are reflected, at least two lighting units 2 are provided. A pair of first and second lighting units 2-1 and 2-2 are provided, and these first and second lighting units 2-1 and 2-2 are separated from each other by a predetermined interval. , Arranged on the surface of the housing at both upper ends of the mirror 1. The first and second lighting units 2-1 and 2-2 are, for example, a light bulb, a fluorescent lamp, a white LED (white light emitting diode), and the like.

The image pickup unit 3 is a device connected to the control processing unit 5 and, under the control of the control processing unit 5, images the front of the mirror 1 and generates an image (image data) as an analysis target image (analysis target image data). .. In the image pickup unit 3, the image may be a still image or a moving image. For example, in the present embodiment, the image pickup unit 3 is arranged with an imaging optical system for forming an optical image on a predetermined image forming surface, and a light receiving surface aligned with the image forming surface, and the optical image is electrically formed. It is a digital camera or the like provided with an area image sensor that converts an area image sensor into an optical signal, an image processing circuit that generates image data that is data representing an image by image processing the output of the area image sensor, and the like. In the present embodiment, the image pickup unit 3 is arranged on the back surface of the mirror 1 and images the front of the mirror 1 through the mirror 1. For example, the image pickup unit 3 is arranged and fixed so that the objective side of the imaging optical system abuts on the back surface of the mirror 1 in order to prevent the intrusion of dust and the like.

The display unit 4 is a device connected to the control processing unit 5 and displays predetermined information such as an analysis result of the physical condition analyzed by the physical condition analysis device D according to the control of the control processing unit 5. The display unit 4 is, for example, an LCD (liquid crystal display device), an organic EL (ElectroLuminence, OLED (organic light emitting diode)) display device, or the like, from the viewpoint that the physical condition analysis device D can be suitably made thinner. In the present embodiment, the display unit 4 faces the display surface toward the mirror 1 and abuts the display surface on the back surface of the mirror 1 so that the display surface can be referred to from the outside through the mirror 1. It is arranged. The size of the display surface of the display unit 4 may be substantially the same as the size of the mirror 1, or may be smaller than the size of the mirror 1.

The communication IF unit 7 is a communication circuit connected to the control processing unit 5 and for communicating with an external device according to the control of the control processing unit 5. The communication IF unit 7 generates a communication signal containing data to be transferred input from the control processing unit 5 according to a communication protocol used in the network NW described later shown in FIG. 4, and generates the generated communication signal in the network NW. It is transmitted to an external device (for example, a personal computer PC or a server device SV described later shown in FIG. 4) via the above. The communication IF unit 7 receives a communication signal from the external device via the network NW, extracts data from the received communication signal, and converts the extracted data into data in a format that can be processed by the control processing unit 5. And output to the control processing unit 5. The communication IF unit 7 is, for example, a communication card that communicates by wire or wirelessly by a communication network such as a mobile communication network or a data communication network, a communication interface circuit according to the standard of the IEEE802 series, and the like. The communication IF unit 7 further uses standards such as Bluetooth (registered trademark) standard, IrDA (Infrared Data Association) standard, and USB (Universal Serial Bus) standard to input / output data to / from an external device. It may be provided with an interface circuit for performing the above.

The storage unit 6 is a circuit connected to the control processing unit 5 and stores various predetermined programs and various predetermined data according to the control of the control processing unit 5. The various predetermined programs include, for example, control processing programs such as a control program, a user determination program, a feature amount processing program, an analysis program, an identification information update program, and a normal range adjustment program. The control program is a program that controls each part 2 to 4, 6 and 7 of the physical condition analyzer D according to the function of each part. The user determination program is a program that determines whether or not the user is the user of the user identification information stored in the identification information storage unit 61, which will be described later, based on the analysis target image captured by the image pickup unit 3. The feature amount processing program is a program for obtaining a predetermined feature amount used for pathological diagnosis as a feature amount at the time of analysis from an analysis target image captured by the image pickup unit 3. When the analysis program determines that the user is the user of the user identification information stored in the identification information storage unit 61 by the user determination program, the user identification information determined by the user determination program is used. This is a program for analyzing a physical condition of a user based on a determination reference feature amount stored in the reference feature amount storage unit 62 described later and the feature amount at the time of analysis obtained by the feature amount processing program. When the identification information update program is determined by the user determination program to be a user of the user identification information stored in the identification information storage unit 61, the user determined by the user determination program is the user. This is a program in which the user identification information stored in the identification information storage unit 61 of the user of the identification information is updated and stored in the identification information storage unit 61 based on the analysis target image captured by the image pickup unit 3. The normal range adjustment program is a program for adjusting the normal range, which will be described later. The various predetermined data include, for example, user identification information, determination reference feature amount, past physical condition information, determination threshold value, reference color, and other data necessary for analyzing the physical condition. Such a storage unit 6 includes, for example, a ROM (Read Only Memory) which is a non-volatile storage element, an EEPROM (Electrically Erasable Programmable Read Only Memory) which is a rewritable non-volatile storage element, and the like. The storage unit 6 includes a RAM (Random Access Memory) or the like that serves as a working memory of the so-called control processing unit 5 that stores data or the like generated during the execution of the predetermined program. The storage unit 6 stores the above-mentioned user identification information, determination standard feature amount, past physical condition information, determination threshold value, and reference color, respectively, in order to store the identification information storage unit 61, the reference feature amount storage unit 62, and the past body. It functionally includes a state information storage unit 63, a threshold storage unit 64, a normal range storage unit 65, and a reference color storage unit 66.

The identification information storage unit 61 stores the user identification information. The user identification information is information (data) for identifying and identifying the user in order to authenticate the user of the physical condition analyzer D. The user identification information may be, for example, a user's name (user name), an identifier (ID) assigned to the user, or the like, but the user identification information is the user name, ID, or the like. In this case, an input unit that accepts the input is required. Therefore, from the viewpoint that the input unit can be eliminated, in the present embodiment, the user identification information identifies the user from the image captured by the image pickup unit 3. It is an image (face image, face image data) in which the user's face is imprinted so that it can be identified.

The reference feature amount storage unit 62 stores the determination reference feature amount (data of the determination reference feature amount) in the user of the user identification information stored in the identification information storage unit 61. The determination standard feature amount is a predetermined feature amount used for pathological diagnosis and is the feature amount used as a determination standard when analyzing a physical condition. The predetermined feature amount is a color (hue, saturation, lightness), shape, contrast, etc. in an image region (user image region) in which a user is imprinted, which is obtained from an image captured by the image pickup unit 3. More specifically, in the present embodiment, the feature amount includes a first feature amount and a second feature amount which is a component of the first feature amount. The first feature amount is, for example, the color of the white eye portion (white portion in the eyeball, conjunctival portion). In this first feature amount, since the second feature amount can suitably analyze the possibility of jaundice, it is a blue component (blue component of hue) in the color of the white of the eye portion, and the possibility of conjunctivitis can be suitably analyzed. Therefore, it is a red component (red component of hue) in the color of the white eye portion. Further, for example, the first feature amount is the color of the black eye portion (the part of the retina and the pupil in the optic nerve), and in this first feature amount, the second feature amount is at least one of cataract and wing-shaped pieces. And the possibility of at least one of retinal hemorrhage, retinal pigment degeneration, retinal choroidal atrophy, retinal choroiditis, optic nerve atrophy and optic nerve inflammation can be suitably analyzed. be. Further, for example, the first feature amount is the color of the cheek portion, and in this first feature amount, the second feature amount can be suitably analyzed for the possibility of kidney disease, so that the brightness in the color of the cheek portion is used. be.

The past physical condition information storage unit 63 stores the past physical condition information of the user of the user identification information stored in the identification information storage unit 61. The past physical condition information is at least one of electronic medical record information representing the contents of the medical record and health diagnosis result information representing the result of the health diagnosis in the user (data). More specifically, the past physical condition information includes, for example, vital measurement results, blood test results, hospital visit history and medical history, chronic illness, and the like. In the present embodiment, the past physical condition information also includes the analysis result analyzed by the analysis unit 54 as described later.

The threshold value storage unit 64 stores the determination threshold value (data of the determination threshold value) in the user of the user identification information stored in the identification information storage unit 61. The determination threshold is a threshold used for analysis of the physical condition. In this embodiment, the first and second feature amounts, in particular the second feature amount, may cause jaundice, choroiditis, at least one of cataracts and winglets, retinal hemorrhage, retinitis pigmentosa. Since the possibility of at least one of disease, retinal choroidal atrophy, retinal choroiditis, optic neuritis and optic neuritis, and the possibility of kidney disease are analyzed, the determination threshold is the first to fifth determination. Includes threshold. The first determination threshold is a threshold used for determining whether or not there is a possibility of jaundice based on the blue component in the color of the white eye portion. In the blue component of the color of the white of the eye, if the first subtraction result of subtracting the judgment reference feature from the feature at the time of analysis is a negative value equal to or higher than the predetermined first judgment threshold, it is determined that there is a possibility of jaundice. To. The second determination threshold is a threshold used for determining whether or not there is a possibility of conjunctivitis based on the red component in the color of the white of the eye portion. In the red component in the color of the white of the eye, it is determined that there is a possibility of conjunctivitis when the second subtraction result of subtracting the judgment standard feature amount from the feature amount at the time of analysis is a positive value equal to or higher than the predetermined second judgment threshold value. To. The third determination threshold is a threshold used for determining whether or not there is a possibility of at least one of cataract and pterygium based on the lightness in the color of the black eye portion. At least one of cataract and pterygium when the third subtraction result of subtracting the judgment standard feature amount from the feature amount at the time of analysis is a positive value equal to or higher than the predetermined third judgment threshold value in the lightness of the color of the black eye portion. It is determined that there is a possibility of. The fourth determination threshold is the possibility of at least one of retinal hemorrhage, retinal pigment degeneration, retinal choroidal atrophy, retinal choroiditis, optic nerve atrophy and optic neuritis based on the lightness in the color of the black eye portion. It is a threshold used to determine whether or not. Retinal hemorrhage, retinal pigment degeneration, retinal choroid, when the 4th subtraction result of subtracting the judgment standard feature amount from the feature amount at the time of analysis is a negative value equal to or higher than the predetermined 4th judgment threshold value in the lightness of the color of the black eye part. It is determined that there is a possibility of at least one of atrophy, retinal choroiditis, optic nerve atrophy and optic neuritis. The fifth determination threshold is a threshold used for determining whether or not there is a possibility of kidney disease based on the lightness in the color of the cheek portion. In the brightness of the color of the cheek part, if the 5th subtraction result obtained by subtracting the judgment standard feature amount from the feature amount at the time of analysis is a negative value equal to or higher than the predetermined 5th judgment threshold value, it is determined that there is a possibility of kidney disease. To. These first to fourth determination thresholds have a plurality of set values according to the difference in color tone in the eyeball color, such as when the eyeball color is relatively light, when the eyeball color is relatively dark, and when the eyeball color is different. It is set appropriately from the sample of. That is, for example, the first determination threshold is the first a determination threshold when the eyeball color is relatively light, the first b determination threshold when the eyeball color is relatively dark, and the firstc determination threshold when the eyeball color is brown. , And a first d determination threshold when the eyeball color is blue, and the like. Further, as the fifth determination threshold value, a plurality of set values according to the difference in skin color (difference in race) and the like are appropriately set from the plurality of samples. That is, for example, the fifth determination threshold includes a plurality of thresholds such as a fiftha determination threshold for white races, a fifthb determination threshold for yellow races, and a fifthc determination threshold for black races.

Preferably, the identification information storage unit 61 stores one or more user identification information, and the reference feature amount storage unit 62 corresponds the one or more determination reference feature amounts to the one or more user identification information. The past physical condition information storage unit 63 stores one or a plurality of past physical condition information in association with the one or a plurality of user identification information, and the threshold storage unit 64 stores one or a plurality of determinations. A threshold value (one or a plurality of first to fifth determination thresholds in the present embodiment) may be stored in association with the one or a plurality of user identification information. Preferably, the identification information storage unit 61 stores one or more user identification information in association with one or a plurality of users (for example, a user's name or ID), and the reference feature amount storage unit 62 stores the identification information. One or a plurality of determination criterion feature amounts are stored in association with the one or a plurality of users, and the past physical condition information storage unit 63 corresponds to the one or a plurality of past physical condition information with the one or a plurality of users. The threshold storage unit 64 may attach and store one or a plurality of determination thresholds (one or a plurality of first to fifth determination thresholds in the present embodiment) in association with the one or a plurality of users. ..

In the present embodiment, the user identification information, the judgment reference feature amount, the past physical condition information and the judgment threshold value (one or a plurality of first to fifth judgment threshold values in the present embodiment) are collectively stored in one table. The identification information storage unit 61, the reference feature amount storage unit 62, the past physical condition information storage unit 63, and the threshold value storage unit 64 are also used for each other. The base information table TB for registering the user identification information, the determination reference feature amount, the past physical condition information, and the determination threshold value (one or a plurality of first to fifth determination threshold values in the present embodiment) is shown in FIG. 3, for example. As described above, the user identification information field 621 for registering the user identification information and the judgment standard feature amount field 622 for registering the judgment reference feature amount in the user of the user identification information registered in the user identification information field 621. , Use of the past physical condition information field 623 for registering the past physical condition information in the user of the user identification information registered in the user identification information field 621 and the user identification information registered in the user identification information field 621. A determination threshold value field 624 for registering a determination threshold value for a person is provided, and a record is provided for each user identification information. Then, in the present embodiment, as shown in FIG. 3, the base information table TB is the user's name (user name, ID) and basic attribute information of the user identification information registered in the user identification information field 621. A user name field 611 and a basic attribute information field 612 for registering each are further provided.

In the determination standard feature amount field 622, in the present embodiment, the first determination reference feature amount for retinal, the color of the white eye portion, which is used when determining the possibility of retinal based on the blue component in the color of the white eye portion. Second criterion feature quantity for conjunctivitis used in determining the possibility of conjunctivitis based on the red component in Retinal hemorrhage, retinal pigment degeneration, retinal choroidal atrophy, retinal choroiditis, optic nerve atrophy and optic nerve based on the third criterion feature amount for cataracts, winged pieces, and lightness in the color of the black eye. The possibility of kidney disease is determined based on the fourth criterion feature amount for retinal hemorrhage, etc. used in determining the possibility of at least one of the inflammations, and the lightness in the color of the cheek portion. The fifth criterion feature amount for kidney disease used in the case is registered. In the determination threshold field 624, the first to fifth determination thresholds are registered in the present embodiment. In the basic attribute information field 612, the gender, date of birth (age), eyeball color tone, skin color, and the like of the user are registered as the basic attribute information.

These user names, basic attribute information, and past physical condition information are, for example, as shown in FIG. 4, a terminal device (for example, a personal computer or a smart phone) as a user interface that is communicably connected to the physical condition analyzer D. Etc.) Input from the PC at an appropriate timing such as when the user Ob starts using the physical condition analyzer D, a new record is generated, and the user name field 611 in this newly generated record, It is registered in the basic attribute information field 612 and the past physical condition information field 623. At this timing, for example, the terminal device PC prompts the user Ob to be in front of the mirror 1, and the image pickup unit 3 generates an image of the user Ob. A person area is extracted from the generated image of the user Ob by the background subtraction method. From this person region, for example, by a circular or elliptical Hough transform, by pattern matching using, for example, a pre-prepared head model (template), or by, for example, a neural network trained for head detection, the user. The image of the head region of Ob is extracted as a face image. The extracted face image is regarded as user identification information, and this user identification information (face image) is registered in the user identification information field 621 in the newly generated record. Then, the first to fourth determination threshold values corresponding to the color tone of the eyeball color in the input and registered basic attribute information are registered in the newly generated determination threshold value field 624, and the input and registered basic attribute information is registered. The fifth determination threshold value corresponding to the skin color in the above is registered in the newly generated determination threshold value field 624. It should be noted that the past physical condition information is obtained from, for example, as shown in FIG. 4, from the server device SV for managing the electronic medical record, which is communicably connected to the physical condition analysis device D and is arranged in, for example, a hospital HS or the like. The user name may be searched by the search key, downloaded, and registered in the past physical condition information field 623. After each information is registered in this way, if the user is in front of the mirror 1 during a predetermined preparation period such as one week, two weeks, or one month, the control processing unit 5 is used each time. The image pickup unit 3 generates an image, and the predetermined feature amount is obtained based on the generated image, and is stored in the storage unit 6 in association with the user identification information or the user name. When the predetermined feature amount is obtained, the color shift is corrected in the same manner as the color shift correction performed when the feature amount at the time of analysis is obtained, which will be described later. When the predetermined preparation period elapses, the average value of the plurality of obtained predetermined feature amounts is obtained as the determination reference feature amount, and the user identification information is registered in the user identification information field 621, or a record. , The user name is registered in the determination standard feature amount field 622 in the record for registering the user name in the user name field 611. In one example, each information (data) is registered in each field 611, 612, 621 to 624 of the base information table TB in this way.

Returning to FIG. 1, the normal range storage unit 65 stores the normal range (data in the normal range). The normal range is used to determine whether or not the physical condition is normal, and is a range in which the physical condition is normal. In the present embodiment, the determination of whether or not the physical condition is normal is carried out by the first feature amount of the feature amount at the time of analysis. Therefore, the normal range is the first normal range indicating the range in which the color of the white eye portion is normal, the second normal range representing the range in which the color of the black eye portion is normal, and the range in which the color of the cheek portion is normal. It consists of a third normal range representing. Each of the first to third normal ranges is appropriately set using a plurality of samples, and is stored as a default value in the normal range storage unit 65. As will be described later, each of the first to third normal ranges is adjusted by the normal range adjusting unit 56 based on the past physical condition information based on this default value.

The reference color storage unit 66 stores the reference color (reference color data). The reference color is a color that serves as a reference when performing color deviation correction performed when obtaining a feature amount at the time of analysis. For example, a reference value for red that corrects a red component and a green component are used. It is provided with a reference value for green to be corrected and a reference value for blue to correct the blue component. For example, at the time of initial setting of the physical condition analysis device D, the control processing unit 5 turns on the illumination unit 2 (2-1, 2-2) for color correction in the analysis target image obtained by the image pickup unit 3. The color of the region is obtained as the reference color and is stored in the reference color storage unit 66. The color correction area is an area of an image in which a background portion in which a person is not reflected in the analysis target image is captured, and is located at the upper right end of the analysis target image, for example, which is usually considered not to include a person. A predetermined small area, a predetermined small area located in the center of the upper portion thereof, a predetermined small area located at the left end of the upper portion, and the like.

The control processing unit 5 is a circuit for controlling each unit 2 to 4, 6 and 7 of the physical condition analysis device D according to the function of each unit and analyzing the physical condition. The control processing unit 5 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits. By executing the control processing program, the control processing unit 5 functions as a control unit 51, a user determination unit 52, a feature amount processing unit 53, an analysis unit 54, an identification information update unit 55, and a normal range adjustment unit 56. Is configured.

The control unit 51 controls each of the parts 2 to 4, 6 and 7 of the physical condition analysis device D according to the functions of the respective parts, and controls the overall control of the physical condition analysis device D.

The user determination unit 52 determines whether or not the user is the user of the user identification information stored in the identification information storage unit 61 based on the analysis target image captured by the image pickup unit 3. In the present embodiment, as described above, the user identification information is a face image (face image data), and the user determination unit 52 is an analysis target imaged by the image pickup unit 3 by a known face recognition technique. Based on the image, it is determined whether or not the user is the user of the user identification information stored in the identification information storage unit 61. Face recognition techniques include, for example, Hitoshi Imaoka et al., "Face Recognition Techniques and Their Applications", NEC Techniques, Vol63 No. 3, 2010 (searched on March 29, 2017, Internet, <URL: http://jpn.nec.com/techrep/journal/g10/n03/pdf/100306.pdf> and the like. The face recognition technology extracts an image of the face region (face image) from the image, detects facial feature points such as eyes, nose, and mouth edge from the extracted face image, and obtains the position of the facial feature points. After normalizing the position and size of the face image using the detection process and the feature point position of the face obtained by this detection process to generate a collation image, this collation image and a pre-registered registered image (book). In the embodiment, the user identification information corresponds to this), and the collation process for finding and collating the similarity with the user identification information is provided.

The feature amount processing unit 53 obtains the predetermined feature amount used for pathological diagnosis as the feature amount at the time of analysis from the analysis target image captured by the image pickup unit 3. When obtaining the feature amount at the time of analysis, in the present embodiment, the feature amount processing unit 53 obtains the feature amount from the analysis target image captured by the image pickup unit 3, and the obtained feature amount is used as the reference color storage unit. The corrected feature amount corrected based on the reference color stored in 66 is obtained as the feature amount at the time of analysis.

When the analysis unit 54 determines that the user is the user of the user identification information stored in the identification information storage unit 61 by the user determination unit 52, the analysis unit 54 of the user identification information determined by the user determination unit 52 The physical condition of the user is analyzed based on the determination reference feature amount stored in the reference feature amount storage unit 62 and the feature amount at the time of analysis obtained by the feature amount processing unit 53. More specifically, the analysis unit 54 obtains a difference between the determination reference feature amount stored in the reference feature amount storage unit 62 and the feature amount at the time of analysis obtained by the feature amount processing unit 53, and the obtained difference and the difference. , The physical condition of the user of the user identification information determined by the user determination unit 52 is analyzed by comparing with the determination threshold stored in the threshold storage unit 64. Further, the analysis unit 54 determines whether or not the physical condition is normal by determining whether or not the feature amount at the time of analysis obtained by the feature amount processing unit 53 is within a predetermined normal range. More specifically, in the present embodiment, the analysis unit 54 determines whether or not the first analysis feature amount (the analysis feature amount of the first feature amount) obtained by the feature amount processing unit 53 is within a predetermined normal range. By determining whether or not the physical condition is normal, the analysis unit 54 determines that the condition is not within the normal range, and the determination reference feature amount stored in the reference feature amount storage unit 62. And the difference between the feature amount at the time of the second analysis (feature amount at the time of analysis of the second feature amount) obtained by the feature amount processing unit 53, and the obtained difference and the user determined by the user determination unit 52. The physical condition of the user of the identification information is analyzed by comparing with the determination threshold stored in the threshold storage unit 64.

The identification information updating unit 55 determines the user identification by the user determination unit 52 when the user determination unit 52 determines that the user is the user of the user identification information stored in the identification information storage unit 61. The user identification information stored in the identification information storage unit 61 of the information user is updated and stored in the identification information storage unit 61 based on the analysis target image captured by the image pickup unit 3.

The normal range adjusting unit 56 stores in the normal range storage unit based on the past physical condition information stored in the past physical condition information storage unit 63 in the user of the user identification information determined by the user determination unit 52. It adjusts the normal range.

Next, the operation of this embodiment will be described. FIG. 5 is a flowchart showing the operation of the physical condition analyzer. FIG. 6 is a flowchart showing each process in the user identification process in the flowchart shown in FIG. FIG. 7 is a flowchart showing each process in various processes of the user's past physical condition information in the flowchart shown in FIG. FIG. 8 is a flowchart showing each process in the feature amount extraction process in the flowchart shown in FIG. FIG. 9 is a flowchart showing each process of the analysis process based on the black eye portion in the analysis process of the flowchart shown in FIG. FIG. 10 is a flowchart showing each process of the analysis process based on the white eye portion in the analysis process of the flowchart shown in FIG. FIG. 11 is a flowchart showing each process of the analysis process based on the cheek portion in the analysis process of the flowchart shown in FIG. FIG. 12 is a flowchart showing each process in the process of the analysis result in the flowchart shown in FIG.

In the physical condition analyzer D having the above configuration, when the power is turned on by turning on the power switch (not shown), the necessary initialization of each part is executed and the operation is started. By executing the control processing program, the control processing unit 5 is functionally configured with a control unit 51, a user determination unit 52, a feature amount processing unit 53, an analysis unit 54, and an identification information updating unit 55. In the initial setting, the control processing unit 5 lights the illumination unit 2 (2-1, 2-2), the image pickup unit 3 generates a background image, and the color is used as a reference color from the color correction area of the background image. The obtained reference color is stored in the reference color storage unit 66 of the storage unit 6.

Then, in one example, as described above, the user Ob connects the terminal device PC to the physical condition analysis device D so as to be able to communicate with the physical condition analysis device D, and from this terminal device D, the user name and basic attribute information. And when the past physical condition information is input and the message displayed on the terminal device PC prompts the user to stand in front of the mirror 1, the image pickup unit 3 generates an image of the user Ob, and the image of the user Ob is used as a face. The image is extracted as user identification information. Then, the first to fourth determination threshold values according to the color tone of the eyeball color in the input basic attribute information are set, and the fifth determination threshold value according to the skin color is set. Each of the user identification information, the past physical condition information, and the determination threshold is stored in the identification information storage unit 61, the past physical condition information storage unit 63, and the threshold storage unit 64 in the storage unit 6. In the present embodiment, the user name, the basic attribute information, the user identification information, the past physical condition information, and the determination threshold value are each of the fields 611, 612, 621, and 623 of the record newly generated in the base information table TB. , 624 and stored in the storage unit 6. If necessary, the past physical condition information may be searched for by the user name as a search key from the server device SV that manages the electronic medical record, downloaded, and stored in the storage unit 6. Then, a determination reference feature amount is obtained from the plurality of predetermined feature amounts obtained during the preparation period, and the determined determination reference feature amount is stored in the reference feature amount storage unit 62 in the reference feature amount storage unit 62, and in the present embodiment, the base information table TB. Is registered in the determination criterion feature amount field 622 and stored in the storage unit 6.

When each information customized in the user Ob is stored in the storage unit 6, the analysis of the physical condition is started, and the physical condition of the user Ob is naturally changed to the daily mirror 1 by the following operations. It is automatically carried out when it is used. It is assumed that the physical condition analysis device D can communicate with the above-mentioned server device SV that manages the electronic medical record.

When the user Ob goes in front of the mirror 1, for example, when the user Ob is detected by a motion sensor (such as a pyroelectric type), the physical condition analysis device D is the control unit of the control processing unit 5 in FIG. The first and second lighting units 2-1 and 2-2 are turned on by 51 (S1).

Next, the physical condition analysis device D executes the acquisition process of the analysis target image by the control unit 51 of the control processing unit 5 (S3). More specifically, the control unit 51 takes an image with the image pickup unit 3 and generates an image as an analysis target image. As a result, the image to be analyzed is acquired. Since the first and second lighting units 2-1 and 2-2 illuminate the user Ob from the upper ends of the mirror 1, the image of the user Ob reflected in the analysis target image captured by the image pickup unit 3 is included in the image of the user Ob. , Shadows are hard to form, and the image to be analyzed can be generated in a stable shooting environment with the same lighting environment. In the present embodiment, the possibility of a disease is determined (pathological diagnosis) based on the change in color, so such a stable imaging environment is preferable.

Next, the physical condition analysis device D executes the user authentication process by the user determination unit 52 of the control processing unit 5.

More specifically, in FIG. 6, the user determination unit 52 executes a face authentication process (S501) by a known face authentication technique based on the analysis target image acquired by the image pickup unit 3 in the process S3. Then, it is determined whether or not the user Ob of the analysis target image is a user of the user identification information stored in the identification information storage unit 61 (S502). More specifically, the user determination unit 52 first extracts an image (face image) of the face region from the analysis target image acquired by the image pickup unit 3 in the process S3. Next, the user determination unit 52 obtains, for example, the positions of the feature points of the eyes, the nose, and the ends of both mouths from the extracted face image. Next, the user determination unit 52 normalizes the position and size of the face image using each feature point position of the obtained face to generate a collation image. Then, the user determination unit 52 collates this collation image with the user identification information (registered image) registered in the user identification information field 621 in the base information table TB, and matches (matches) the collation image. It is determined whether or not the user identification information (registered image) is present. As a result of this determination, when there is no user identification information (registered image) that matches (matches) the collated image (No), the physical condition analyzer D is then processed by the control processing unit 5 in the processing S503. To execute. On the other hand, as a result of the determination, when the user identification information (registered image) matching the collation image exists (Yes), the physical condition analysis device D then performs the process S504 by the control processing unit 5. Run.

In this process S503, the physical condition analysis device D reads out from the storage unit 6 the first to fifth determination threshold values for general use as the values used by the analysis unit 54 in the process S7 described later by the control process unit 5. Then, the process S6 is executed. The first to fifth determination threshold values for general use are appropriately set and prepared in advance based on a plurality of samples, and are stored in the storage unit 6 in advance as one of the various predetermined data.

In the process S504, the physical condition analysis device D is registered in the user identification information field 621 of the base information table TB, which is determined by the identification information update unit 55 of the control process unit 5 to match the collation image in the process S502. The user identification information (registered image) is updated based on the analysis target image acquired by the image pickup unit 3 in the process S3, and then the process S505 is executed and then the process S6 is executed.

In this process S505, the physical condition analysis device D executes various processes of the user's past physical state information by the control process unit 5, and then executes the process S6.

More specifically, in the various processes S505 of the user's past physical condition information, in the present embodiment, for example, each process shown in FIG. 7 is executed.

In FIG. 7, next, the physical condition analysis device D uses the user identification information (registered image) determined by the control processing unit 5 to match the collation image in the processing S502 as the user identification information in the base information table TB. Stores the user name, past physical condition information, and first to fifth determination thresholds registered in each of the user name field 611, the past physical condition information field 623, and the determination threshold field 624 in the record registered in the field 621. Read from unit 6 and acquire (S551).

Next, the physical condition analysis device D searches for the user name acquired in the process S551 from the server device SV that manages the electronic medical record by the control processing unit 5 using the search key, downloads the user's electronic medical record, and downloads the user's electronic medical record. Acquire (S552).

Next, the physical condition analysis device D determines whether or not the electronic medical record has been updated by the control processing unit 5 (S553). More specifically, the control processing unit 5 determines whether or not the electronic medical record has been updated by comparing the past physical condition information acquired in the process S551 with the electronic medical record acquired in the process S552. As a result of this determination, if there is no difference between the two, the control processing unit 5 determines that the electronic medical record has not been updated (No), and then executes the process S557. On the other hand, as a result of the determination, if there is a difference between the two, the control processing unit 5 determines that the electronic medical record has been updated (Yes), and the content of the electronic medical record acquired in the processing S552 is used in the processing S502. The past physical condition information registered in the past physical condition information field 623 in the record for registering the user identification information (registered image) determined to match the collation image in the user identification information field 621 of the base information table TB. Update, register, and then execute process S554.

In this process S554, the physical condition analyzer D determines what kind of illness is being treated by the control process unit 5. As a result of this determination, if there is no disease being treated (No), the control processing unit 5 then executes the process S555, while as a result of the determination, if there is a disease being treated (Yes). Next, the control processing unit 5 executes the processing S556.

In this processing S555, since there is no disease being treated, the control processing unit 5 reads the normal range stored in the normal range storage unit 65 of the storage unit 6, sets the normal range with this default value, and then sets the normal range. , Process S6 is executed.

In this processing S556, the control processing unit 5 reads the normal range stored in the normal range storage unit 65 of the storage unit 6 by the normal range adjusting unit 56, and adjusts this default value according to the disease being treated. , A new normal range is set with this adjusted value, and then the process S6 is executed. More specifically, in the normal range adjustment unit 565, the disease under treatment is combined with the disease that is the subject of analysis in the treatment S7 described later or the disease that is the subject of analysis in the treatment S7 described later. In the case of a disease that develops as a result, the normal range of the disease is narrowed by a predetermined ratio, and this narrowed range is set as a new normal range. For example, when the disease being treated is jaundice, in the present embodiment, the possibility of jaundice is analyzed by the color of the white of the eye, so that the first normal range of the default value is a predetermined ratio (for example, 5% or 10). % Etc.), and this narrowly adjusted range is set as a new first normal range. Also, for example, if the disease being treated is hypertension, the third normal range of kidney disease that may develop as a complication of this disease is narrowed by a predetermined percentage and set to a new third normal range. To.

On the other hand, in the processing S557, the physical condition analyzer D determines whether or not the treatment has been completed by the control processing unit 5. For example, when the electronic chart includes a treatment completion flag indicating whether or not the treatment is completed, this determination refers to the treatment completion flag of the electronic chart acquired in the process S552, and when the treatment completion flag is present (or the treatment completion flag). Is "1" indicating the completion of treatment), it is determined that the treatment is completed, and when there is no treatment completion flag (or when the treatment completion flag is "0" indicating that the treatment is not completed), it is determined that the treatment is completed. , Judge that the treatment is not complete. Further, for example, this determination refers to the issuance status of the prescription, and if the issuance of the prescription that has been issued regularly is stopped, it is determined that the treatment is completed, and the issuance of the prescription is continued. Judges that the treatment is not complete. As a result of this determination, when the treatment is completed (Yes), the control processing unit 5 then executes the process S6, while when the result of the determination is the completion of the treatment (No), the control processing unit 5 executes the process S6. The control processing unit 5 then executes the process S558.

In this process S558, the physical condition analyzer D determines whether or not the regular medical examination is possible by the control process unit 5. More specifically, for example, the control processing unit 5 obtains the average number of hospital visit intervals from the treatment date (date of description of the medical record, hospital visit date) in the electronic medical record acquired in the process S552, and determines the average number of hospital visit interval days. Is multiplied by a constant (eg 1.3, 1.5, etc.), the multiplication result is added to the final treatment day, and it is determined whether or not today's date exceeds the addition result date. As a result of this determination, if today's date exceeds the date of the addition result, the control processing unit 5 determines that the regular consultation cannot be performed (No), and then executes the processing S559. On the other hand, as a result of the determination, if today's date does not exceed the date of the addition result, the control processing unit 5 determines that the periodical consultation has been performed (Yes), and then executes the process S6.

In this process S559, the physical condition analyzer D displays a notification of recommendation for regular consultation such as "Please go to the hospital" on the display unit 4 only for a predetermined time by the control process unit 5, and processes S6. Run.

Returning to FIG. 5, in this process S6, the physical condition analysis device D obtains the feature amount at the time of analysis by the feature amount processing unit 53 of the control processing unit 5. More specifically, the feature amount processing unit 53 obtains the predetermined feature amount as the feature amount at the time of analysis from the analysis target image captured by the image pickup unit 3 in the processing S2. More specifically, the feature amount processing unit 53 obtains the predetermined feature amount from the analysis target image captured by the image pickup unit 3 in the processing S3, and the obtained feature amount is stored in the reference color storage unit 66 as a reference. The corrected feature amount corrected based on the color is obtained as the feature amount at the time of analysis.

In the present embodiment, the possibility of a predetermined disease is analyzed based on the color of the white eye portion, the color of the black eye portion, and the color of the cheek portion. A person region is extracted from the analysis target image captured by the image pickup unit 3 in S3 by the background subtraction method (S601). Next, the feature amount processing unit 53 extracts a face area from the extracted person area, for example, by Hough transform of an ellipse or by pattern matching using a head model (template) (S602). Next, in order to extract the eye region and the cheek region, the feature amount processing unit 53 extracts an edge from the extracted image of the face region with an edge filter to generate an edge image, and the generated edge image is used. Divide it into four parts vertically and horizontally, and create a pair of horizontally long left and right elliptical shapes located at the center position in the up and down direction or slightly above this center position, for example, by cheek transformation of the ellipse, or by eye model ( By pattern matching using the template), a pair of left and right eye regions are extracted, and a lower constant region is extracted as a cheek region with respect to the extracted eye region (S603). The extracted image of the cheek region is used as the cheek portion in the image to be analyzed. Next, the feature amount processing unit 53 divides at least one of the extracted left and right eye regions into a white eye region and a black eye region based on the pixel values, and an image of the white eye region (white eye image, white eye) in the analysis target image. The portion) and the image of the black eye region (black eye image, black eye portion) in the analysis target image are extracted (S604). Next, the feature amount processing unit 53 obtains each analysis-time feature amount from the white eye portion, the black eye portion, and the cheek portion (S605). More specifically, the feature amount processing unit 53 obtains the red component in the extracted white eye portion by, for example, averaging each red component of each pixel in the white eye portion, and obtains the blue component in the extracted white eye portion, for example, the white eye portion. It is obtained by averaging each blue component of each pixel in the portion, and the green component in the extracted white eye portion is obtained by, for example, averaging each green component of each pixel in the white eye portion. As a result, the color of the white eye portion (red component, blue component, green component) is determined as the first feature amount for the white eye portion, and the red component and the blue component for the white eye portion are determined as the second feature amount for the white eye portion. Similarly, the feature amount processing unit 53 obtains the red component in the extracted black eye portion by, for example, averaging each red component of each pixel in the black eye portion, and obtains the blue component in the extracted black eye portion, for example, the black eye portion. The green component in the extracted black eye portion is obtained by averaging each blue component of each pixel in, for example, and the brightness in the black eye portion is determined based on these by averaging each green component of each pixel in the black eye portion. demand. As a result, the color of the black eye portion (red component, blue component, green component) is obtained as the first feature amount for the black eye portion, and the lightness of the black eye portion is obtained as the second feature amount for the black eye portion. Similarly, the feature amount processing unit 53 obtains the red component in the extracted cheek portion by, for example, averaging each red component of each pixel in the cheek portion, and obtains the blue component in the extracted cheek portion, for example, the cheek portion. The green component in the extracted cheek portion is obtained by averaging each blue component of each pixel in, for example, the green component in each cheek portion is obtained by averaging, and the brightness in the cheek portion is determined based on these. demand. As a result, the color of the cheek portion (red component, blue component, green component) is determined as the first feature amount for the cheek portion, and the brightness of the cheek portion is determined as the second feature amount for the cheek portion. When both the left and right eye regions are used, each red component, each blue component, each green component, and each brightness are obtained in each of the left and right eye regions, and the red component, the blue component, and the green are obtained. The average of each of the components and the lightness is obtained, and each average value may be the final red component, blue component, green component, and lightness values. Next, in order to correct the color shifts in the red component, the blue component, the green component, and the brightness, the feature amount processing unit 53 changes the color of the color correction region of the analysis target image captured by the image pickup unit 3 in the processing S3. The correction value of each component is obtained based on the color of the obtained color correction area and the reference color stored in the reference color storage unit 66. Then, the feature amount processing unit 53 includes the red component, the blue component and the green component in the obtained white eye portion, the red component, the blue component, the green component and the lightness in the obtained black eye portion, and the obtained cheek eye portion. The red component, blue component, green component and lightness are each corrected with each correction value, and the corrected white eye color, red component and green component, black eye color and lightness, and cheeks are used as feature quantities at the time of each analysis. Find the color and lightness of the part. As a result, for example, the color of the white eye portion, the red component and the green component, the color and the brightness of the black eye portion, as the feature amount at the time of each analysis, in which the color shift caused by the change of the illumination light in the illumination unit 2 due to aged deterioration or the like is corrected, are corrected. In addition, the color and brightness of the cheek portion are required. In the above description, the brightness itself has been corrected, but the brightness after the color shift correction may be obtained by using the red component, the blue component, and the green component after the color shift correction.

Returning to FIG. 5, after the execution of such processing S6, the physical condition analysis device D uses the user identification information determined by the analysis unit 54 of the control processing unit 5 by the user determination unit 52 in the processing S5. An analysis process for analyzing the physical condition is executed based on the determination reference feature amount stored in the reference feature amount storage unit 62 and the feature amount at the time of analysis obtained by the feature amount processing unit 53 in the processing S6. S7).

In the present embodiment, the possibility of a predetermined disease is analyzed based on the color of the white eye portion, the color of the black eye portion, and the color of the cheek portion. Therefore, in one example, the color of the black eye portion is analyzed in FIG. First, the color (red component, blue component, green component) of the black eye portion as the first analysis feature amount (the analysis feature amount of the first feature amount) obtained in the process S605 is within the second normal range. It is determined whether or not there is (S710). As a result of this determination, when the color of the black eye portion is within the second normal range (Yes), the analysis unit 54 determines that there is no abnormality (S713), and the physical condition analysis device D is determined by the control processing unit 5. Next, the process S8 is executed. On the other hand, as a result of the determination, when the color of the black eye portion is not within the second normal range (No), the analysis unit 54 then executes the process S711.

In this process S711, the analysis unit 54 determines whether or not the color brightness in the black eye portion as the second feature amount at the time of analysis (feature amount at the time of analysis of the second feature amount) obtained in the process S605 is high. .. More specifically, the determination reference feature amount field in the record in which the user identification information (registered image) determined to match the collated image in the process S502 is registered in the user identification information field 621 of the base information table TB. The determination reference feature amount for cataracts and pterygium registered in 622 is read from the storage unit 6 and acquired, and is obtained from the brightness in the color of the black eye portion as the feature amount at the time of the second analysis obtained in the process S605. It is determined whether or not the acquired third subtraction result obtained by subtracting the determination reference feature amount for the pterygium and the pterygium is a positive value equal to or higher than the third determination threshold acquired in the process S505. As a result of this determination, when the brightness is not high, that is, when the third subtraction result is not a positive value equal to or higher than the third determination threshold value (No), the analysis unit 54 determines at least one of cataract and pterygium. In terms of the possibility, it is determined that there is no abnormality, and then the process S712 is executed. On the other hand, when the result of the determination is high brightness, that is, when the result of the third subtraction is a positive value equal to or higher than the third determination threshold value (Yes), there is a possibility of at least one of cataract and pterygium. (S715), the physical condition analysis device D then executes the process S8 by the control process unit 5.

In this process S712, the analysis unit 54 determines whether or not the lightness of the color in the black eye portion as the second feature amount at the time of analysis (feature amount at the time of analysis of the second feature amount) obtained in the process S605 is low. .. More specifically, the determination reference feature amount field in the record in which the user identification information (registered image) determined to match the collation image in the process S502 is registered in the user identification information field 621 of the base information table TB. The criterion feature amount for retinal hemorrhage, etc. registered in 622 is read from the storage unit 6 and acquired, and is obtained from the brightness in the color of the black eye portion as the feature amount at the time of the second analysis obtained in the process S605. It is determined whether or not the fourth subtraction result obtained by subtracting the acquired determination reference feature amount for retinal hemorrhage or the like is a negative value equal to or higher than the fourth determination threshold value acquired in the process S505. As a result of this determination, when the brightness is not low, that is, when the fourth subtraction result is not a negative value equal to or higher than the fourth determination threshold (No), the analysis unit 54 determines retinal hemorrhage, retinitis pigmentosa, and retina. It was determined that there was no abnormality in at least one of choroidal atrophy, retinal choroiditis, optic nerve atrophy, and optic neuritis (S713), and the physical condition analyzer D was then determined by the control processing unit 5 to be next. Process S8 is executed. On the other hand, when the result of the determination is low, that is, when the result of the fourth subtraction is a negative value equal to or higher than the fourth determination threshold (Yes), the analysis unit 54 determines that retinal hemorrhage, retinitis pigmentosa, and the like. It is determined that there is a possibility of at least one of retinal choroidal atrophy, retinal choroiditis, optic nerve atrophy and optic neuritis (S714), and the physical condition analyzer D is then subjected to processing S8 by the control processing unit 5. Run.

Then, in one example, regarding the color of the white eye portion, in FIG. 10, the analysis unit 54 first first analyzes the white eye portion as the first analysis feature amount (analysis feature amount of the first feature amount) obtained in the process S605. It is determined whether or not the color (red component, blue component, green component) of is within the first normal range (S720). As a result of this determination, when the color of the white eye portion is within the first normal range (Yes), the analysis unit 54 determines that there is no abnormality (S723), and the physical condition analysis device D is determined by the control processing unit 5. Next, the process S8 is executed. On the other hand, as a result of the determination, when the color of the white eye portion is not within the first normal range (No), the analysis unit 54 then executes the process S721.

In this process S721, the analysis unit 54 determines whether or not the blue component in the color of the white eye portion as the second feature amount at the time of analysis (feature amount at the time of analysis of the second feature amount) obtained in the process S605 is low. To. More specifically, the determination reference feature amount field in the record in which the user identification information (registered image) determined to match the collated image in the process S502 is registered in the user identification information field 621 of the base information table TB. The determination reference feature amount for jaundice registered in 622 is read from the storage unit 6 and acquired, and the acquired jaundice is obtained from the blue component in the color of the white eye portion as the feature amount at the time of the second analysis obtained in the process S605. It is determined whether or not the first subtraction result obtained by subtracting the determination reference feature amount for use is a negative value equal to or greater than the first determination threshold value acquired in the process S505 (S721). As a result of this determination, when the blue component is not low, that is, when the first subtraction result is not a negative value equal to or higher than the first determination threshold value (No), the analysis unit 54 determines the possibility of jaundice. It is determined that there is no abnormality, and then the process S722 is executed. On the other hand, when the blue component is low as a result of the determination, that is, when the first subtraction result is a negative value equal to or higher than the first determination threshold value (Yes), the analysis unit 54 considers that there is a possibility of jaundice. After making a determination (S725), the physical condition analyzer D then executes the process S8 by the control process unit 5.

In the process S722, the analysis unit 54 determines whether or not the red component in the color of the white eye portion as the second feature amount at the time of analysis (feature amount at the time of analysis of the second feature amount) obtained in the process S605 is high. To. More specifically, the determination reference feature amount field in the record in which the user identification information (registered image) determined to match the collated image in the process S502 is registered in the user identification information field 621 of the base information table TB. The determination reference feature amount for conjunctivitis registered in 622 is read from the storage unit 6 and acquired, and the acquired conjunctivitis is obtained from the red component in the color of the white of the eye portion as the feature amount at the time of the second analysis obtained in the process S605. It is determined whether or not the second subtraction result obtained by subtracting the determination reference feature amount for is a positive value equal to or higher than the second determination threshold value acquired in the process S505. As a result of this determination, when the red component is not high, that is, when the second subtraction result is not a positive value equal to or higher than the second determination threshold value (No), the analysis unit 54 determines the possibility of conjunctivitis. It is determined that there is no abnormality (S723), and the physical condition analysis device D then executes the process S8 by the control process unit 5. On the other hand, when the red component is high as a result of the determination, that is, when the second subtraction result is a positive value equal to or higher than the second determination threshold value (Yes), the analysis unit 54 indicates that there is a possibility of conjunctivitis. After making a determination (S724), the physical condition analyzer D then executes the process S8 by the control process unit 5.

Further, in one example, regarding the color of the cheek portion, in FIG. 11, the analysis unit 54 first first analyzes the cheek portion as the first analysis feature amount (analysis feature amount of the first feature amount) obtained in the process S605. It is determined whether or not the color (red component, blue component, green component) of is within the third normal range (S730). As a result of this determination, when the color of the cheek portion is within the third normal range (Yes), the analysis unit 54 determines that there is no abnormality (S732), and the physical condition analysis device D is determined by the control processing unit 5. Next, the process S8 is executed. On the other hand, as a result of the determination, when the color of the cheek portion is not within the third normal range (No), the analysis unit 54 then executes the process S731.

In this process S731, the analysis unit 54 determines whether or not the brightness of the color of the cheek portion as the second feature amount at the time of analysis (feature amount at the time of analysis of the second feature amount) obtained in the process S605 is low. .. More specifically, the determination reference feature amount field in the record in which the user identification information (registered image) determined to match the collated image in the process S502 is registered in the user identification information field 621 of the base information table TB. The determination standard feature amount for kidney disease registered in 622 was read from the storage unit 6 and acquired, and the acquired yellow tint was obtained from the brightness in the color of the cheek portion as the feature amount at the time of the second analysis obtained in the process S605. It is determined whether or not the fifth subtraction result obtained by subtracting the determination reference feature amount for is a negative value equal to or higher than the fifth determination threshold value acquired in the process S505. As a result of this determination, when the brightness is not low, that is, when the fifth subtraction result is not a negative value equal to or higher than the fifth determination threshold value (No), the analysis unit 54 determines that there is a possibility of kidney disease. It is determined that there is no abnormality, and then the process S732 is executed. On the other hand, when the brightness is low as a result of the determination, that is, when the fifth subtraction result is a negative value equal to or higher than the fifth determination threshold value (Yes), the analysis unit 54 indicates that there is a possibility of kidney disease. After making a determination (S733), the physical condition analyzer D then executes the process S8 by the control process unit 5.

Returning to FIG. 5, in the process S8, the physical condition analyzer D determines whether or not the control process unit 5 has determined that the process S7 may have some kind of illness. In this embodiment, the control processing unit 5 has at least one of the possibility of cataracts and winglets, retinal hemorrhage, retinitis pigmentosa, retinal choroidal atrophy, retinal chorioretinitis, optic nerve atrophy and optic neuritis. Determine if at least one of any of the following, retinal, chorioretinitis, and kidney disease is determined to be possible. As a result of this determination, at least one of cataracts and winglets, retinal hemorrhage, retinitis pigmentosa, retinal chorioretinitis, retinal chorioretinitis, optic neuritis and optic neuritis, If it is determined that there is no possibility of cataract, possibility of chorioretinitis, and possibility of kidney disease (No), the physical condition analyzer D ends this process, while the above determination. As a result, at least one of cataracts and winglets, retinal hemorrhage, retinitis pigmentosa, retinal chorioretinitis, retinal chorioretinitis, optic neuritis and at least one of optic neuritis, jaundice If at least one of the possibility, the possibility of chorioretinitis, and the possibility of kidney disease is determined to be possible (Yes), the physical condition analyzer D is the control processing unit 5. (S9), the processing of the analysis result is executed, and the present processing is terminated.

In the analysis result processing S9, the physical condition analysis device D stores the analysis result and the like by the control processing unit 5, and displays the analysis result as necessary. More specifically, in FIG. 12, the control processing unit 5 stores the analysis result and the like in the storage unit 6 (S901). More specifically, in the past, the control processing unit 5 registers the user identification information (registered image) determined to match the collation image in the process S502 in the user identification information field 621 of the base information table TB. The analysis result is added and registered in the physical condition information field 623. As a result, the analysis result of this time is stored (recorded) in the storage unit 6.

Next, the control processing unit 5 determines whether or not all the disease names included in the analysis result in the processing S7 are the disease names under treatment based on the determination result of the processing S554. As a result of this determination, if all the disease names are being treated (Yes), the control processing unit 5 ends the processing. On the other hand, when not all the disease names are being treated (No), the control processing unit 5 displays the analysis result on the display unit 4 and ends the processing. Here, preferably, the display unit 4 may display the analysis result of the remainder excluding the name of the disease being treated from the analysis result, but the display unit 4 may display all of the analysis results. As described above, the display unit 4 corresponds to an example of an output unit that outputs the analysis result of the physical condition analyzed by the analysis unit to the outside. If necessary, the analysis result of the process S7 may be output from the communication IF unit 7 to an external device. In this case, the communication IF unit 7 corresponds to another example of an output unit that outputs the analysis result of the physical condition analyzed by the analysis unit to the outside.

As described above, the physical condition analysis device D and the physical condition measurement method mounted on the physical condition analysis device D in the present embodiment have an image pickup unit 3 provided on the mirror 1 to capture an image in front of the mirror 1 to analyze an image. Was generated, and based on this analysis target image, it was determined whether or not the user identification information stored in the identification information storage unit 61 was a user Ob, and as a result of this determination, it was stored in the identification information storage unit 61. When it is determined that the user identification information is the user Ob, the determination reference feature amount in the user Ob of the determined user identification information and the analysis-time feature obtained based on the analysis target image. The physical condition is analyzed based on the amount and the analysis result is output to the outside. Therefore, in the physical condition analysis device D and the physical condition analysis method, the image pickup unit 3 provided in the mirror 1 generates an analysis target image by imaging the front of the mirror 1, and therefore, for example, face washing, tooth brushing, and makeup. You can analyze your physical condition without being aware of the natural movement of looking at the mirror 1 in your daily activities such as up, hair setting, attaching and detaching contact lenses, and refer to the output of the analysis results. This makes it possible to check the daily physical condition during the natural movement. Then, the physical condition analysis device D and the physical condition analysis method determine whether or not the user identification information stored in the identification information storage unit 61 is the user Ob when analyzing the physical condition, and this determination is made. Since the physical condition is analyzed based on the judgment standard feature amount and the feature amount at the time of analysis in the user Ob of the user identification information, the physical condition analyzer D and the physical condition analysis method are performed by a plurality of users. Even when it is used, the physical condition is analyzed by the criterion feature amount of the user Ob, so that the physical condition can be analyzed more appropriately.

In the physical condition analysis device D and the physical condition analysis method, the user identification information stored in the identification information storage unit 61 is updated in the identification information storage unit 61 based on the analysis target image captured by the image pickup unit 3. Since it is memorized, even if the appearance of the user Ob changes, the user Ob can be determined more appropriately. Therefore, since the physical condition is analyzed by the determination reference feature amount of the user Ob, the physical condition analyzer and the physical condition analysis method can analyze the physical condition more appropriately.

The physical condition analysis device D and the physical condition analysis method store a determination threshold value used for analysis of the physical condition in the user, and analyze the physical condition with the determination threshold value of the user. Therefore, the physical condition analysis device D and the physical condition analysis method can customize the determination threshold value according to each user, and can analyze the physical condition more appropriately.

The physical condition analysis device D and the physical condition analysis method adjust the normal range based on the past physical condition information of the user of the user identification information determined by the user determination unit 52. Therefore, the physical condition analysis device D and the physical condition analysis method can more appropriately determine whether or not the user is within the normal range by considering the past physical condition information of each user.

The physical condition analysis device D and the physical condition analysis method determine whether or not the user is within the normal range, and then analyze the physical condition when the user is not within the normal range. Therefore, the physical condition analysis device and the physical condition analysis method can skip the process of analyzing the physical condition when it is within the normal range, while the analysis is performed in two steps, so that the physical condition can be analyzed more appropriately.

In the above-described embodiment, the predetermined feature amount is the color of the white eye portion, the color of the black eye portion, and the color of the cheek portion, but the present invention is not limited to this, and other features used for pathological diagnosis are not limited to this. It may be various quantities. For example, instead of or in addition to the above, when the first feature amount is the color of the cheek portion, the second feature amount can suitably analyze the possibility of jaundice, and thus the color of the cheek portion. It is a blue component (blue component of hue) in the above, and since the possibility of liver cirrhosis can be suitably analyzed, it may be the lightness in the color of the cheek portion. In the blue component of the color of the cheek portion, the sixth subtraction result obtained by subtracting the judgment reference feature amount from the second analysis feature amount (the second feature amount at the time of analysis) is a negative value equal to or higher than the predetermined sixth judgment threshold. In some cases, it is determined that there is a possibility of jaundice. In the lightness of the color of the cheek part, it is judged that there is a possibility of liver cirrhosis when the 7th subtraction result of subtracting the judgment reference feature amount from the feature amount at the time of the 2nd analysis is a negative value equal to or more than the predetermined 7th judgment threshold value. Will be done. As for the sixth and seventh determination threshold values, a plurality of setting values according to the difference in skin color are appropriately set from the plurality of samples, as in the case of the first to fifth determination threshold values described above. Also in the case of analyzing the possibility of jaundice and the possibility of liver cirrhosis, a normal range similar to the first to third normal ranges (fourth normal range) may be provided. Further, this fourth normal range may be adjusted not only based on past physical condition information but also according to, for example, fair-skinned or fair-skinned. Alternatively, the feature amount may be at eye level because the possibility of osteoporosis can be suitably analyzed in place of or in addition to these above. At the eye level position, when the 8th subtraction result obtained by subtracting the judgment reference feature amount from the feature amount at the time of analysis is a negative value equal to or higher than the predetermined 8th judgment threshold value, it is determined that there is a possibility of osteoporosis. The set value of the eighth determination threshold value is appropriately set from a plurality of samples, and is set to several centimeters such as 1 cm, 2 cm, and 3 cm.

Further, in the above-described embodiment, as shown by the broken line in FIG. 1, the physical condition analyzer D obtains a plurality of the feature quantities from the plurality of analysis target images captured by the image pickup unit 3, and the obtained plurality of the features are obtained. The determination reference feature amount generation unit 57, which obtains the average value of the feature amounts as the determination reference feature amount and stores the determined determination reference feature amount in the reference feature amount storage unit 62, is functionally further added to the control processing unit 5. You may prepare. For example, the determination reference feature amount generation unit 57 obtains the feature amount from the analysis target image captured by the image pickup unit 3 in the process S3 before or after the above-mentioned process S505 is executed. , The average value of the obtained feature amount and the determination reference feature amount stored in the reference feature amount storage unit 62 in the user Ob of the user identification information determined by the user determination unit 52 is obtained, and this The determination reference feature amount stored in the reference feature amount storage unit 62 is updated and stored with the obtained average value. According to this, the judgment standard feature amount is finely adjusted according to the daily change of each user, and the physical condition can be analyzed more appropriately. Further, the determination reference feature amount generation unit 57 may generate the determination reference feature amount during the preparation period.

Further, in the above-described embodiment, the terminal device PC is communicably connected to the physical condition analysis device D, and as a result of the determination of the process S502, there is no user identification information (registered image) that matches the collation image. In the case (No), the physical condition analyzer D may perform the process of newly registering the user before the execution of the process S503. In the process of newly registering a user, first, the physical condition analysis device D causes the control processing unit 5 to display a message as to whether or not to newly register the user on the terminal device PC, and waits for a reply. When the reply of the terminal device PC means that the reply is not newly registered, the control processing unit 5 then executes the process S503, while when the reply of the terminal device PC means that the reply is newly registered, the control processing unit 5 executes the process S503. The processing unit 5 generates user identification information (collation image) based on the analysis target image acquired by the imaging unit 3 in the processing S3, and inputs the user name, basic attribute information, and past physical condition information. Display the prompting message on the terminal device PC and wait for a reply. Upon receiving this reply, the control processing unit 5 generates a new record in the base information table TB, and the user name field 611, the basic attribute information field 612, and the user identification information field 621 in the newly generated record. And the user name, the basic attribute information, the user identification information (collation image), and the past physical condition information are registered in each of the past physical condition information fields 623. The control processing unit 5 registers the fifth determination threshold value corresponding to the basic attribute information in the newly generated determination threshold value field 624. The past physical condition information may be searched for by the user name as a search key from the server device SV that manages the electronic medical record, downloaded, and registered in the past physical condition information field 623, as described above. Then, a predetermined preparation period for generating the determination reference feature amount is started, and the control processing unit 5 then executes the processing S503. Then, when the predetermined preparation period elapses, the control processing unit 5 obtains the average value of the plurality of the predetermined feature amounts obtained during the preparation period as the determination reference feature amount, and determines this as the user identification. The information is registered in the determination standard feature amount field 622 in the record in which the information is registered in the user identification information field 621 or the record in which the user name is registered in the user name field 611. In this way, the process of registering a new user is executed.

In order to express the present invention, the present invention has been appropriately and sufficiently described through the embodiments with reference to the drawings described above, but those skilled in the art can easily change and / or improve the above-described embodiments. It should be recognized that it is possible. Therefore, unless the modified or improved form implemented by a person skilled in the art is at a level that deviates from the scope of rights of the claims stated in the claims, the modified form or the improved form is the scope of rights of the claims. It is interpreted to be included in.

D Physical condition analyzer 1 Mirror 2 (2-1, 2-2) Lighting unit 3 Imaging unit 4 Display unit 5 Control processing unit 6 Storage unit 7 Communication interface unit (communication IF unit)
51 Control unit 52 User judgment unit 53 Feature amount processing unit 54 Analysis unit 55 Identification information update unit 56 Normal range adjustment unit 57 Judgment standard feature amount generation unit 61 Identification information storage unit 62 Reference feature amount storage unit 63 Past physical condition information storage Unit 64 Threshold storage unit 65 Normal range storage unit 66 Reference color storage unit

Claims (6)

With a mirror
An image pickup unit that images the front of the mirror and generates an image as an image to be analyzed.
An identification information storage unit that stores user identification information for identifying and identifying users,
A user determination unit that determines whether or not the user identification information stored in the identification information storage unit is a user based on the analysis target image captured by the imaging unit.
A reference feature amount storage unit that stores the feature amount, which is a predetermined feature amount used for pathological diagnosis in the user and is a judgment standard when analyzing a physical condition, as a judgment reference feature amount.
A feature amount processing unit that obtains the feature amount as a feature amount at the time of analysis from an analysis target image captured by the image pickup unit, and a feature amount processing unit.
When the user determination unit determines that the user is the user of the user identification information stored in the identification information storage unit, the user of the user identification information determined by the user determination unit may use the user identification information. An analysis unit that analyzes a physical condition based on the determination reference feature amount stored in the reference feature amount storage unit and the analysis-time feature amount obtained by the feature amount processing unit.
It is equipped with an output unit that outputs the analysis result of the physical condition analyzed by the analysis unit to the outside.
The user identification information is a face image in which the face of the user is imprinted.
The user determination unit determines whether or not the user is a user of the user identification information stored in the identification information storage unit based on the analysis target image captured by the image pickup unit by the face recognition technique.
When the user determination unit determines that the user is the user of the user identification information stored in the identification information storage unit, the user of the user identification information determined by the user determination unit The user identification information stored in the identification information storage unit is further provided with an identification information update unit that updates the user identification information stored in the identification information storage unit based on the analysis target image captured by the imaging unit and stores it in the identification information storage unit.
Physical condition analyzer. With a mirror
An image pickup unit that images the front of the mirror and generates an image as an image to be analyzed.
An identification information storage unit that stores user identification information for identifying and identifying users,
A user determination unit that determines whether or not the user identification information stored in the identification information storage unit is a user based on the analysis target image captured by the imaging unit.
A reference feature amount storage unit that stores the feature amount, which is a predetermined feature amount used for pathological diagnosis in the user and is a judgment standard when analyzing a physical condition, as a judgment reference feature amount.
A feature amount processing unit that obtains the feature amount as a feature amount at the time of analysis from an analysis target image captured by the image pickup unit, and a feature amount processing unit.
When the user determination unit determines that the user is the user of the user identification information stored in the identification information storage unit, the user of the user identification information determined by the user determination unit may use the user identification information. An analysis unit that analyzes a physical condition based on the determination reference feature amount stored in the reference feature amount storage unit and the analysis-time feature amount obtained by the feature amount processing unit.
It is equipped with an output unit that outputs the analysis result of the physical condition analyzed by the analysis unit to the outside.
Further, a threshold value storage unit for storing a determination threshold value used for analysis of the physical condition of the user is provided.
The analysis unit obtains a difference between the determination reference feature amount stored in the reference feature amount storage unit and the feature amount at the time of analysis obtained by the feature amount processing unit, and the obtained difference and the user determination. The physical condition of the user of the user identification information determined by the unit is analyzed by comparing with the determination threshold stored in the threshold storage unit.
Physical condition analyzer. The analysis unit determines whether or not the physical condition is normal by determining whether or not the feature amount at the time of analysis obtained by the feature amount processing unit is within a predetermined normal range.
Past physical condition information storage unit that stores at least one of the electronic medical record information representing the contents of the medical record in the user and the health diagnosis result information representing the result of the health diagnosis in the user as past physical condition information. When,
Further, a normal range adjusting unit that adjusts the normal range based on the past physical condition information stored in the past physical condition information storage unit in the user of the user identification information determined by the user determination unit. Prepare, prepare
The physical condition analyzer according to claim 1 or 2. The feature amount includes a first feature amount and a second feature amount which is a component of the first feature amount.
The feature amount processing unit obtains the first and second feature amounts as the feature amounts at the time of the first and second analysis, respectively.
The analysis unit determines whether or not the physical condition is normal by determining whether or not the feature amount at the time of the first analysis obtained by the feature amount processing unit is within a predetermined normal range. ,
When the analysis unit determines that it is not within the normal range, the determination reference feature amount stored in the reference feature amount storage unit and the feature amount at the time of the second analysis obtained by the feature amount processing unit The physical condition is analyzed by obtaining a difference and comparing the obtained difference with the judgment threshold stored in the threshold storage unit in the user of the user identification information determined by the user determination unit. do,
The physical condition analyzer according to claim 3, wherein claim 2 is cited . On the computer
A user who determines whether or not the user is the user of the user identification information stored in the identification information storage unit that stores the user identification information for identifying and identifying the user based on the captured image to be analyzed. Judgment process and
A feature amount processing step of obtaining a predetermined feature amount used for pathological diagnosis as a feature amount at the time of analysis from the analysis target image, and
When it is determined in the user determination step that the user is the user of the user identification information stored in the identification information storage unit, the body of the user of the user identification information determined in the user determination step. The reference feature amount stored in the reference feature amount storage unit that stores the feature amount as the judgment standard when analyzing the state as the judgment reference feature amount, and the feature amount at the time of analysis obtained in the feature amount processing step. Based on the analysis process that analyzes the physical condition,
It is a physical condition analysis program for executing an output step of outputting the analysis result of the physical condition analyzed in the analysis step to the outside.
The user identification information is a face image in which the face of the user is imprinted.
The user determination step determines whether or not the user is the user of the user identification information stored in the identification information storage unit based on the analysis target image by the face recognition technique.
When it is determined in the user determination step that the user is the user of the user identification information stored in the identification information storage unit, the user of the user identification information determined in the user determination step Further comprising an identification information updating step of updating the user identification information stored in the identification information storage unit based on the analysis target image and storing the user identification information in the identification information storage unit.
Physical condition analysis program. On the computer
A user who determines whether or not the user is the user of the user identification information stored in the identification information storage unit that stores the user identification information for identifying and identifying the user based on the captured image to be analyzed. Judgment process and
A feature amount processing step of obtaining a predetermined feature amount used for pathological diagnosis as a feature amount at the time of analysis from the analysis target image, and
When it is determined in the user determination step that the user is the user of the user identification information stored in the identification information storage unit, the body of the user of the user identification information determined in the user determination step. The reference feature amount stored in the reference feature amount storage unit that stores the feature amount as the judgment standard when analyzing the state as the judgment reference feature amount, and the feature amount at the time of analysis obtained in the feature amount processing step. Based on the analysis process that analyzes the physical condition,
It is a physical condition analysis program for executing an output step of outputting the analysis result of the physical condition analyzed in the analysis step to the outside.
In the analysis step, the difference between the determination reference feature amount stored in the reference feature amount storage unit and the feature amount at the time of analysis obtained in the feature amount processing step is obtained, and the obtained difference and the user determination are obtained. The physical condition is analyzed by comparing with the determination threshold used for the analysis of the physical condition stored in the threshold storage unit in the user of the user identification information determined in the process.
Physical condition analysis program.

Images