KR102491139B1 - Method and Device for checking the health condition by skin reaction - Google Patents

Abstract

As a preferred embodiment of the present invention, the health condition check method through skin reaction includes the steps of selecting at least one skin area where an abnormality has occurred on a human body model and uploading an image of the selected area, skin abnormal reaction or accompaniment to the selected area Step of inputting symptoms, presenting questions about whether or not to take medications or medical questionnaires, and receiving information on medications taken by the user or information on questionnaire responses, and adverse skin reactions or accompanying symptoms input by the user, information on medications taken, Characterized in that it includes; analyzing the user's health condition based on at least one of questionnaire response information or an uploaded image.

Description

Terminal or method for checking the health condition through skin reaction {Method and Device for checking the health condition by skin reaction}

The present invention relates to a method and a terminal for checking a user's health condition. More specifically, the present invention relates to a method of checking a user's health condition by using a skin condition for each body part uploaded by the user.

Recently, as interest in skin health care has increased, devices and medical devices for skin diagnosis or skin care have been developed. In relation to technologies for diagnosing skin diseases currently being developed, imaging devices that simply enlarge the skin, devices for diagnosing the degree of pigmentation of the skin, and devices that provide aging information are being provided.

However, these skin diagnosis devices are devices that can be used when a user or patient is in a hospital, and are insufficient to promptly guide a user to a medical review opinion on skin abnormalities that occur in daily life.

KR 10-1812406 B1

In a preferred embodiment of the present invention, in a situation where the user does not receive medical treatment directly at the hospital, when an abnormality occurs in his or her skin, the abnormal skin condition is notified or recorded and transmitted through the terminal used by the user, so that the user's I would like to suggest a method and a terminal for checking the health condition.

In a preferred embodiment of the present invention, even if the medical staff does not treat for 24 hours, the user checks the abnormal skin reaction transmitted by the user, and if a problem occurs to the user, urgently calls patients in the order of high risk to check the health condition that can be responded to. I would like to propose a terminal and method for

As a preferred embodiment of the present invention, a terminal for checking health status through skin reaction includes a camera, a display, a memory, a processor and a communication unit; a controller for storing and updating an image analysis algorithm library and a machine learning algorithm library that can be performed by the processor in the memory; a selection interface unit for displaying a human body model on the display and providing an interface for a user to select at least one skin region where an abnormality has occurred; an image input interface for uploading an image of the selected region; a symptom input interface for inputting an abnormal skin reaction or accompanying symptom for the selected area; A drug input interface that presents a query on whether or not to take medication and receives information about the drug taken by the user; and a medical examination input interface that presents a medical questionnaire and receives the user's questionnaire response information, wherein the control unit includes the upload An image processing unit that calculates the proportion of the skin abnormality type or range of the skin abnormality identified on the basis of the obtained image in the human body model; and the skin abnormal reaction or accompanying symptom input by the user, the drug information taken by the user, and the medical examination Characterized in that it further comprises; health analysis unit for analyzing the user's health condition based on the response information and the uploaded image.

Preferably, the control unit further includes a notification unit for providing an alarm to at least one of the user, medical personnel, and emergency responders according to the level of the user's health condition analyzed by the health analysis unit.

As another preferred embodiment of the present invention, a terminal for checking a health condition through a skin reaction includes a camera, a display, a memory, a processor, and a communication unit; a control unit for storing and updating an image analysis algorithm library and a machine learning algorithm that can be performed by the processor in the memory; a selection interface unit for displaying a human body model on the display and providing an interface for a user to select at least one skin region where an abnormality has occurred; an image input interface for uploading an image of the selected region; A drug input interface that presents a query on whether or not to take medication and receives information about the drug taken by the user; and a medical examination input interface that presents a medical questionnaire and receives the user's questionnaire response information, wherein the control unit includes the upload It is characterized in that the user's health condition is analyzed based on at least one of the recorded image, the drug information, and the questionnaire response information.

As another preferred embodiment of the present invention, the health status check method through skin reaction includes selecting at least one skin area where an abnormality occurs in a human body model; Uploading an image of the selected region; inputting an abnormal skin reaction or accompanying symptoms for the selected area; processing a proportion of the shape or range of the skin abnormality identified on the basis of the uploaded image in the human body model; presenting a query on whether or not the user has taken the drug and receiving information on the drug taken by the user; Presenting a medical questionnaire and receiving medical questionnaire response information of a user; and analyzing the user's health condition based on the skin abnormal reaction or accompanying symptom input by the user, the drug information taken by the user, the questionnaire response information, and the uploaded image.

As a preferred embodiment of the present invention, the step of matching and displaying the uploaded image for each part of the human body model diagram on the human body model diagram; characterized in that it further comprises.

As a preferred embodiment of the present invention, the specific gravity of the range of the skin abnormality is displayed on the human body model diagram, and the amount of change in the specific gravity of the skin abnormality over time is further displayed.

As a preferred embodiment of the present invention, the step of analyzing the user's health condition is a result of matching the disease name of the skin abnormality occurring for each selected part based on the uploaded image, and analyzing the uploaded image generated for each selected part. It is characterized in that it further comprises; analyzing which stage of the progression of the disease that can occur by disease name.

As a preferred embodiment of the present invention, after analyzing the progression of the disease for each selected part, the skin abnormal reaction or accompanying symptoms input by the user, the drug information taken by the user, and the questionnaire response information were selected as It is characterized in that the user's health condition is analyzed by further referring to each part. In this case, the method may further include providing an alarm to at least one or more of a user, medical personnel, and emergency responders based on the progression of the disease.

As a preferred embodiment of the present invention, it is characterized in that the amount of change in the image is displayed by tracking the uploaded image for each selected part selected from the human body model diagram according to time.

As a preferred embodiment of the present invention, the image is analyzed to indicate whether the change in the image is in a direction in which the user's health improves or deteriorates, and the speed of the change is further displayed.

As a preferred embodiment of the present invention, the types of skin abnormalities displayed in the uploaded image are classified and displayed by matching with the anatomical model for each selected part according to the classified skin abnormalities, and the types of skin abnormalities are keratin, spots, and papules. , acne appearance, ulcers, erythema, pigment changes, nodules, wheals, hemorrhages, blisters, bullae, and pus blisters.

As a preferred embodiment of the present invention, the human body model is characterized in that it is provided in a two-dimensional or three-dimensional form.

As another preferred embodiment of the present invention, the health status check method through skin reaction includes selecting at least one skin area where an abnormality occurs in a human body model; Uploading an image of the selected region; presenting a query on whether or not the user has taken the drug and receiving information on the drug taken by the user; Presenting a medical questionnaire and receiving questionnaire response information of the user; and analyzing the user's health condition based on at least one of the uploaded image, the drug information, and the questionnaire response information. do.

The present invention analyzes abnormal reactions occurring in the user's skin, records the user's medications taken by the user and accompanying symptoms that occur to the user, cumulatively stores and learns the abnormal records, It is possible to check the current state of health through the terminal.

In addition, even in the case of patients who are not admitted to the hospital, there is an effect of tracking and monitoring the degree of abnormal skin disease occurring in the patient, the rate of deterioration, etc., and, if necessary, preferentially calling patients with high risk to treat the patient.

1 is a system diagram showing the operation of a terminal that checks a health condition through a skin reaction as a preferred embodiment of the present invention.
2 is a diagram showing the internal configuration of a terminal that checks a health condition through a skin reaction as a preferred embodiment of the present invention.
3 to 5 show an example in which an uploaded image or an analysis result of the uploaded image is displayed on the human body model in a preferred embodiment of the present invention, in which a skin area is selected through the front and back surfaces of the two-dimensional human body model. .
6 shows an example of selecting a skin area from a 3D human body model and uploading an image as a preferred embodiment of the present invention.
7 to 9 illustrate an embodiment in which a control unit generates a medical questionnaire and presents it to a user, and an example of a method for preparing a medical questionnaire using a decision tree in a control unit, as a preferred embodiment of the present invention.
10 (a) to (c) show another example of a medical examination provided to a user through a medical examination input interface as a preferred embodiment of the present invention.
Figure 11 shows a flow chart of a health condition check method through skin reaction as a preferred embodiment of the present invention.
12 is another preferred embodiment of the present invention, showing a flow chart of a health status check method through skin reaction.

It will be described with reference to the drawings below.

FIG. 1 shows a system diagram 100 in which a terminal for checking health conditions through skin reactions operates as a preferred embodiment of the present invention. 2 shows an internal configuration diagram of the user terminal 200 .

An example in which the terminal 110 operates in the system 100 will be described with reference to FIGS. 1 and 2 . As a preferred embodiment of the present invention, the terminal 110 that checks the health condition through skin reaction is a mobile phone, smart phone, handheld device, wearable device, tablet, laptop computer, PC, computer, smart watch, smart TV, etc. can be implemented in the form of

As a preferred embodiment of the present invention, the terminal 110 can communicate with at least one server 120 by wire or wirelessly, and download, update, control, etc. of applications between the terminal 110 and the server 120 can be implemented. there is.

The at least one server 120 may include at least one of a patient medical record management server 130, an image processing server 140, an emergency patient management server 150, and a machine learning server 160, and the server 130 , 140, 150, 160) can be implemented to enable mutual wired/wireless communication.

Referring to FIG. 2 , as a preferred embodiment of the present invention, the terminal 200 includes a control unit 210, a communication unit 220, a camera 230, a memory 240 and a display 246, and a display ( 246 may be implemented to support at least one of the selection interface 250, the image input interface 260, the symptom input interface 270, the drug input interface 280, and the paperwork input interface 290. The memory 240 stores an image analysis algorithm library 242 and a machine learning algorithm library 244 .

The control unit 210 is implemented in the form of a processor, and is implemented to update an image analysis algorithm library and a machine learning algorithm library pre-stored in the memory 240 that can be performed through the processor. The machine learning algorithm library includes algorithms such as DBN (Deep Belief Network), CNN (Convolutional Neural Network), and RNN (Recurrent Neural Network) used for data analysis and prediction, and can include various other machine learning algorithms. .

The display 246 may provide at least one of a selection interface 250, an image input interface 260, a symptom input interface 270, a drug input interface 280, and a medical examination input interface 290.

The selection interface 250 displays a human body model on the display 246 and provides an interface for the user to select at least one skin area where an abnormality has occurred. The human body model diagram may present the front and rear parts of the human body model as in the example shown in FIG. 3 . In addition, as in the example shown in FIG. 6 , a human body model diagram of a 3D model may be presented, and in this case, the front, side, or rear portion of the human body model may be selected by rotating the human body model according to a user's touch.

The image input interface 260 is an interface for uploading an image of a selected part, and the image includes a photo and a video. In another preferred embodiment of the present invention, the image input interface 260 is activated after selecting a specific part of the human body model through the selection interface 250, and may suggest inputting an image to the user. Referring to FIG. 3 , when the user selects the upper left forearm by activating the selection interface 250, the video input interface 260 is activated, and the user can be suggested to input an image (311a). By activating the selection interface 250 and then activating the image input interface 260, the user can upload a photo by matching the part of the human body model with the part where the skin has an abnormality. However, it should be noted that this is an embodiment of the present invention, and that the video input interface 260 can be used regardless of activation of the selection interface 250.

The symptom input interface 270 is implemented to input an abnormal skin reaction or accompanying symptoms for the selected area. The symptom input interface 270 includes both text and voice input interfaces.

The drug input interface 280 presents a query to the user about drug information currently taken and drug information taken in the past, and receives information about the drug taken by the user. The drug input interface 280 may receive drug information described in a prescription drug envelope received from a pharmacy or hospital by a user in the form of an image. The drug input interface 280 includes all of text, voice, and video interfaces.

The medical examination input interface 290 presents a medical examination table to the user and receives the user's medical examination response information. For an example of the medical questionnaire presented to the user, see FIGS. 8 and 10 (a) to (c).

As a preferred embodiment of the present invention, the control unit 210 includes an image processing unit 212 and a health analysis unit 214, and may be implemented to further include a notification unit 216.

The image processing unit 212 calculates the proportion of the shape or range of the skin abnormality identified on the basis of the uploaded image in the human body model. In this case, the image analysis algorithm 242 stored in the memory 240 may be used. For an example of this, refer to FIG. 4 .

The health analysis unit 214 uses the machine learning algorithm 244 to analyze the user's health condition based on the user's entered adverse skin reactions or accompanying symptoms, the user's medication information, questionnaire response information, and uploaded images. do.

After analyzing the user's health condition, the health analysis unit 214 also performs tracking analysis on changes in the user's condition based on the history of the image uploaded by the user, and determines whether the user's condition improves or worsens. If it improves, the rate of improvement, and if it worsens, the rate of deterioration is analyzed.

The health analysis unit 214 classifies each progression stage from stage 1 to stage N for each type of disease, determines that it is in a dangerous state if it deviate from a specific stage, and users who are analyzed to be highly likely to reach a specific stage are also at risk. judge by

As a preferred embodiment of the present invention, the health analysis unit 214 may classify the user into a monitoring group, a risk candidate group, a risk group, an emergency group, and the like, based on images uploaded by each user. In this case, the health analysis unit 214 transmits the classified information to the notification unit 216, and the notification unit 215 preferentially transmits a notification to a user belonging to a high-risk group.

As an example, when the user's disease name determined based on the image uploaded by the user is "Rash acneiform", the health analysis unit 214 comprehensively determines "Pruitus or tenderness" and "No superinfection" As a monitoring group, the health analysis unit 214 may determine the risk state of the analyzed disease according to a predetermined standard, such as classifying a risk group in the case of "pruritus or tenderness" and "with extensive superinfection".

3 to 5 show an example in which an uploaded image or an analysis result of the uploaded image is displayed on the human body model in a preferred embodiment of the present invention, in which a skin area is selected through the front and back surfaces of the two-dimensional human body model. .

3 shows the front side 310 and the back side 320 of the two-dimensional human body model diagram, and the terminal used by the user changes the shape of the human body model diagram to male, female, front or back side, and front and back sides at the same time according to the user's selection. , a human model diagram in which the shape of a body part is layered and displayed, a human body model diagram in which acupoints are layered and displayed, and a human model diagram in which only the shape of the human body is displayed without additional information can be set and displayed on the terminal as shown in FIG. 3 .

3 shows an example of a human body model diagram in which shapes of body parts are displayed in layers. The user can sequentially select (311, 312, 312, 313, 321, 322) the skin area where the abnormality has occurred.

In a preferred embodiment of the present invention, when a user selects one skin area where an abnormality occurs using the selection interface, the video interface is then activated to receive image information of the corresponding area from the user, and then another skin area where an abnormality occurs. It can be implemented to select a skin area and upload an image.

In another preferred embodiment of the present invention, a user may select all skin areas where an abnormality occurs using a selection interface, and then activate an image interface to upload a corresponding image for each selected skin area.

In another preferred embodiment of the present invention, when the user selects all of the skin areas where the abnormality has occurred using the selection interface and uploads a photo of the skin area where the abnormality has occurred, the photo is analyzed through machine learning. Photos may be automatically matched and uploaded to correspond to the corresponding part, and a plurality of pictures may be uploaded to a specific part by date based on the date the picture was taken.

In a preferred embodiment of the present invention, the user can upload using at least one of a selection interface, an image interface, a symptom input interface, a drug input interface, and a questionnaire input interface at regular intervals when a skin abnormality occurs, and the control unit 210 may process the uploaded information in chronological order.

FIG. 4 shows an example in which area information 410a and 420b occupied by skin abnormalities is displayed when a user uploads an image to a human body model on a display as a preferred embodiment of the present invention. In addition, the display may further select the abnormal skin type 430 in addition to selecting a part of the body from the human body model using the selection interface. When the type of skin abnormality is activated, relevant selection menus such as erythema (431), pigment change (432), bleeding (433), and herpes zoster (444) are displayed so that the user can select symptoms related to the skin abnormality. It can be implemented to select specific symptoms.

5 is a preferred embodiment of the present invention, in which the result of machine learning based on the information input by the user for a certain period of time or information collected from the user terminal in the health analysis unit (FIG. 2, 214) is displayed in the human body. It can be displayed on the model diagram.

Referring to FIG. 5, the progression of the disease (510, 520, 530, 540, 550), the degree of risk (514, 524), and the progress of the disease (512, 522, 532, 542, 552) are displayed for each body part. can do. A variety of methods can be used to display the stage of progression of the disease (510, 520, 530, 540, 550), the degree of risk (514, 524), and the rate of progression of the disease (512, 522, 532, 542, 552).

In an embodiment of FIG. 5 , an example of a method that intuitively can be grasped by using a higher number as the stage of progression of the disease worsens and increasing the size of the circle is displayed.

In the case of danger, the risk levels 514 and 524 are displayed so that the user can intuitively recognize them, and although not shown in the drawing, information may be provided through a pop-up screen so that the user can check it more easily.

If the progression of the disease is in the direction of improvement, a ↓ mark can be used, and the size or thickness of the arrow can be changed as the rate of improvement increases. On the other hand, if the progression of the disease is in the direction of deterioration, the sign of ↑ can be used, and the size or thickness of the arrow can be changed as the rate of deterioration increases. In addition, if there is no significant change, ↔ can be used. It should be noted that the display method described above is merely an example and is not limited thereto.

6 shows an example of a 3D human body model 600 as a preferred embodiment of the present invention. The display lists 'date and time' (601), 'gender' (610), a menu section 620 for adjusting the enlargement (621), reduction (622), rotation (623) of the human body model, and body parts. At least one of a tool 630 for selecting a body part and a tool 640 for uploading an image of the selected body part 631 or 642 when a specific body part 631 or 632 is selected may be provided.

7 to 9 illustrate an embodiment in which a control unit generates a medical questionnaire and presents it to a user, and an example of a method for preparing a medical questionnaire using a decision tree in a control unit, as a preferred embodiment of the present invention.

FIG. 7 illustrates an example of receiving or managing skin-related data from a server (120 in FIG. 1 ) in order to generate a medical questionnaire in a control unit as a preferred embodiment of the present invention. As a preferred embodiment of the present invention, the control unit from the patient medical record management server 130, image processing server 140, emergency patient management server 150 or machine learning server 160 as in the example shown in FIG. Question data 700 related to the skin may be received.

The control unit can download necessary machine learning algorithms from the machine learning server 160 as needed, receives the patient's medical record data from the patient medical record management server 130, and the patient's schedule from the image processing server 140. The result of image processing uploaded over a period of time or the result of machine learning of the image processing result may be received. In addition, information on the patient's emergency situation may be further received from the emergency patient management server 150 .

The control unit may synthesize the data obtained from the user terminal and the data obtained from the server (FIG. 1, 120), predict the user's health condition, and provide the user with a necessary medical examination.

As an example, the control unit checks the patient medical record management server 130 in relation to the question sentence data, "Since when did you have skin changes related to the skin abnormal reaction phenomenon 720?" The data may not be used so that the query "Does anyone in the family have the same symptoms?" Alternatively, if the skin change symptoms are not related to the family history, the data may not be used so that the query is not made. As another embodiment, the controller may select the form 740 of the answer to display the answer on the user terminal.

As another embodiment of the present invention, the machine learning server (FIG. 1, 160), when a similar answer is received from the user in relation to a specific skin abnormality, based on the answer received from the user through machine learning and clustering It can be learned to generate question sentences. In this case, refer to an embodiment of FIG. 9 for an example of performing machine learning.

FIG. 8 illustrates an example of displaying, on a user terminal, query data related to skin managed by a server (120 in FIG. 1 ) as a preferred embodiment of the present invention.

When the user selects the abnormal reaction 820a of 'what's wrong with the skin' among the skin 810a abnormalities in the terminal, the controller selects a tab related to the skin 810 in the server, and the question data accumulated and managed in the corresponding tab Among them, through machine learning, the necessary question data is selected and presented to the user in the form of a paperweight. In this case, the question data provided from the server may be displayed in a user-friendly manner on the user terminal.

For example, in the server, the question data related to the abnormal reaction (820), 'What happened to your skin?' ) or 'Are you allergic?' Thus, the paperweight is made. If the user answers '2 days ago' (821b) to the questionnaire 'Since when did you have skin changes?' Required question data can be selected from the server.

9 shows an embodiment of using a decision tree technique capable of classification and regression as a machine learning method in the process of creating a medical questionnaire as a preferred embodiment of the present invention.

Question data 910 of the questionnaire includes essential question items. The mandatory questionnaire items include information on the main complaint, aggravating factors, attenuating factors, other symptoms, and severity of symptoms. The severity of symptoms can be classified as Grade 1, Grade 2, Grade 3,,,,, etc.

In the process of creating the questionnaire, the machine learning unit 940 uses a decision tree technique, etc., at the root node 931 to ask whether the questionnaire response information x1 for the main complaint exceeds the preset criterion c1, and if it exceeds, the intermediate At the node, classification is performed by asking whether question-and-answer information x2 on the aggravating factor exceeds the predetermined criterion c2 (940).

In the process of filling out the questionnaire, the machine learning unit 940 collects the user's answers to the essential question items 910 through the collection unit 941, and the machine learning unit 942 uses a decision tree technique After performing machine learning on the collected data, the analysis unit 943 analyzes the collected data. The analyzer 943 may provide the analyzed data result to the server 120 .

10 (a) to (c) show another example of a medical examination provided to a user through a medical examination input interface as a preferred embodiment of the present invention.

The user terminal provides a selection interface 1010 for selecting the type of skin abnormality and provides a medical questionnaire according to the type of skin abnormality selected by the user. FIG. 10( a ) illustrates an example of presenting a questionnaire asking 'what part of the skin rash is there?' (1020) to the user when the user selects 'skin rash' 1010.

In a preferred embodiment of the present invention, the questionnaire includes questions related to skin abnormalities or queries related to diseases that can be derived from skin abnormalities, and text 1020 and image 1021 as in the embodiment of FIG. 10 (a). can include In addition, the paperweight 1020 may be implemented through a voice interface according to the user's selection.

The user can select the parts 1022a, 1022b, 1022c, and 1022d where the skin abnormality has occurred selected by the user in the human body model 1021 through the terminal.

The questionnaire may determine the contents of the next questionnaire according to the user's questionnaire response information. The contents of the paperweight can be presented through machine learning. Referring to FIG. 10 (b), after selecting the type of skin abnormality called 'skin rash (1010),' a question 'how does it hurt?' (1030) for symptoms (1011) in each part may be presented. . The user can select (1031) the corresponding proposal among the suggested proposals such as 'no pain', 'itchy', 'stinging', 'sore when rubbing', or manually input his or her condition if there is no corresponding proposal. .

If the user submits the questionnaire response information 'It hurts when rubbed', the questionnaire may present questions related to the questionnaire response information through machine learning based on the questionnaire response information. Referring to FIG. 10(c), after selecting the type 1010 of skin rash, a questionnaire about the symptom 1011 related to the skin rash is made, and the cause 1012 related to the skin rash in relation to the user's questionnaire response information. ), 'Are there any suspicious circumstances related to recent skin rashes? (1040)' can be made.

The user may select among examples, drugs, food, travel, and family history presented in the questionnaire, or input a corresponding cause 1041 through text 1042 or voice 1043 if there is no corresponding example.

Figure 11 shows a flow chart of a health condition check method through skin reaction as a preferred embodiment of the present invention. In the health condition check method through skin reaction, at least one skin part where an abnormality has occurred is selected from the human body model (S1110), and an image of the selected part is uploaded (S1120). In this case, information 430 on the skin abnormal shape of the skin area may be further selected and provided as necessary, as in the example shown in FIG. 4A .

The control unit presents a question or questionnaire on whether or not to take medication to the user, and receives information on the medication taken by the user or information on the user's questionnaire response through the medication input interface (S1130 and S1140). After that, the control unit analyzes or monitors the user's health condition based on at least one of the uploaded image, drug information, and questionnaire response information (S1150), and if the user's health condition is an emergency, the emergency patient management server 150 It is possible to inform at least one of the user, guardian, medical personnel or first responders of the condition through the.

12 is another preferred embodiment of the present invention, showing a flow chart of a health status check method through skin reaction.

As another preferred embodiment of the present invention, in the method for checking health condition through skin reaction, at least one skin part where an abnormality has occurred is selected from the human body model (S1210), and an image of the selected part is uploaded (S1220). The user also inputs an abnormal skin reaction or accompanying symptoms for the selected area through the terminal (S1230). The user terminal calculates the proportion of the type of skin abnormality identified on the basis of the uploaded image or the extent of the skin abnormality on the human body model, displays it on the display (S1240), presents a question about whether or not to take medication or a questionnaire to the user, and allows the user to take One drug information or user's questionnaire response information is received (S1250, S1260). The control unit analyzes the user's health condition based on the skin abnormal reaction or accompanying symptoms input by the user, the medication information the user has taken, the questionnaire response information, and the uploaded image (S1270).

Those skilled in the art to which the present invention pertains will be able to understand that it can be easily modified into other specific forms without changing the technical spirit or essential characteristics of the present invention. Therefore, the embodiments described above should be understood as illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The above description of the present invention is for illustrative purposes, and the scope of the present invention is indicated by the following claims rather than the above detailed description, and all changes or modifications derived from the meaning and scope of the claims and equivalent concepts thereof It should be construed as included in the scope of the present invention.

Claims (15)

camera, display, memory and communication unit;
A controller implemented in the form of a processor and updating an image analysis algorithm library and a machine learning algorithm library pre-stored in the memory that can be performed through the processor;
a selection interface for displaying a human body model on the display and providing an interface for a user to select at least one skin region where an abnormality has occurred;
an image input interface for uploading an image of the selected region;
a symptom input interface for inputting an abnormal skin reaction or accompanying symptom for the selected area;
A drug input interface that presents a query on whether or not the user has taken the drug and receives information on the drug taken by the user; and
A medical examination input interface for presenting a medical examination table and receiving a user's medical examination response information;
The control unit
The proportion of the type of skin abnormality or the range of skin abnormality identified on the basis of the uploaded image is calculated and displayed on the human body model, the amount of change in the proportion of skin abnormality over time is calculated and further displayed, and the selection selected from the human body model is calculated. The amount of change in the image is displayed by tracking the uploaded image for each part over time, and based on the analysis result of the image, whether the amount of change in the image is in the direction of improving or deteriorating the user's health, and displaying the amount of change an image processing unit that further displays the speed; and
Characterized in that it further comprises; a health analysis unit that analyzes the user's health condition based on the skin abnormal reaction or accompanying symptoms input by the user, the drug information taken by the user, the questionnaire response information, and the uploaded image. A terminal that checks the health condition through skin reactions. The method of claim 1, wherein the controller
A notification unit for providing an alarm to at least one of the user, medical personnel, and emergency responders according to the degree of the user's health condition analyzed by the health analysis unit; Terminal to check. In the data processing method for skin condition determination performed by the user terminal,
selecting at least one skin area where an abnormality has occurred in the human body model;
Uploading an image of the selected region;
inputting an abnormal skin reaction or accompanying symptoms for the selected area;
As a step of processing the proportion of the skin abnormality type or range of skin abnormality identified on the basis of the uploaded image in the human body model, the proportion of the skin abnormality range is displayed on the human body model, and the proportion of the skin abnormality over time further displaying the amount of change in ;
presenting a query on whether or not the user has taken the drug and receiving information on the drug taken by the user;
Presenting a medical examination table and receiving a user's medical examination response information; And
Analyzing the user's health condition based on the skin abnormal reaction or accompanying symptoms input by the user, the drug information taken by the user, the questionnaire response information, and the uploaded image; Including,
The step of displaying
The amount of change in the image is displayed by tracking the uploaded image for each selected part selected from the human body model over time, and based on the analysis result of the image, it is determined whether the change in the image is in the direction of improving or deteriorating the user's health. Display, characterized in that further displaying the speed of the change amount, data processing method for skin condition determination. According to claim 3,
Characterized in that it further comprises, the data processing method for determining the skin condition; matching and displaying the uploaded image for each part of the human body model on the human body model. delete The method of claim 3, wherein analyzing the user's health condition
Based on the uploaded image, the disease name of the skin abnormality occurring for each selected region is matched, and the result of analyzing the uploaded image generated for each selected region corresponds to which stage of the disease progression that can occur for each disease name. Step; characterized in that it further comprises a data processing method for skin condition determination. According to claim 6,
After analyzing the progress of the disease for each selected part, the user's health condition is further referred to the skin abnormal reaction or accompanying symptoms input by the user, the drug information taken by the user, and the questionnaire response information for each selected part. Characterized in that for analyzing, a data processing method for skin condition determination. The method of claim 6, based on the stage of progression of the disease
Characterized in that it further comprises a data processing method for determining the skin condition; providing an alarm to at least one or more of the user, medical personnel, and first responders. delete delete According to claim 3,
The type of skin abnormality displayed in the uploaded image is classified and displayed by matching with the human body model for each selected part according to the classified skin abnormality type, and the skin abnormality type is keratin, spot, papule, acne shape, ulcer, erythema, pigment A data processing method for determining skin condition, characterized in that it includes changes, nodules, wheals, hemorrhages, blister, vesicles and pus blisters. The method of claim 3, the result of analyzing the user's health condition
Providing an alarm to at least one or more of the user, medical personnel, and emergency responders according to the degree of the user's health condition when a problem with the user's health condition is expected to occur; characterized in that it further comprises, skin condition How to process data for judgment. The method of claim 3, wherein the human body model is provided in a two-dimensional or three-dimensional form. delete delete

Images