KR20230062177A - Method for recognizing symptom of body and estimating chemical substance, and terminal and server performing the same - Google Patents

Abstract

According to an embodiment of the present invention, voice conversation generated by voice conversation between a terminal and a user, body information generated by the terminal sensing the user's body, and environment information generated by sensing the environment in which the user is located are provided. Information collection step provided to the server, symptom recognition step in which the server recognizes symptoms appearing on the user's body based on the voice conversation body information and environment information, and chemical exposure to the user's body based on the recognized symptoms by the server A chemical substance estimation step of estimating a substance, and a question generation step of generating a question to be output to the user when a symptom is not determined in the symptom recognition step or a chemical substance is not determined in the chemical substance estimation step It is possible to quickly and accurately estimate the chemical substances exposed to the user by providing a method for recognizing symptoms of the body and estimating chemicals, a terminal and a server that performs the same.

Description

Method for recognizing symptom of body and estimating chemical substance, and terminal and server performing the same}

The present invention relates to a method for recognizing a symptom of a body and estimating a chemical substance, and a terminal and server for performing the same.

When random chemical substances are leaked from various places such as industrial sites, homes, laboratories, and multi-use facilities and come into contact with the human body or when contact is suspected, it is necessary to quickly find and deal with the contacted chemicals. The human body exhibits various types of symptoms when exposed to chemicals. Chemical substances have different levels of risk to the human body depending on their types, and specific methods for responding to chemical substances are also different. Therefore, it is necessary to estimate what chemicals the human body has come into contact with and respond differently depending on the chemicals.

KR 10-1957382 B1

An object according to an embodiment of the present invention is a method for recognizing symptoms appearing in the human body using a terminal worn on the body or a terminal installed at an industrial site, and estimating what chemical substances are exposed to the human body based on the symptoms, It is for providing a terminal and a server.

A method for recognizing a symptom of a body and estimating a chemical substance according to an embodiment of the present invention includes voice conversation generated by voice conversation between a terminal and a user, body information generated by a terminal sensing a user's body, Information collection step of providing environment information generated by sensing the environment in which the user is located to the server; symptom recognition step of the server recognizing symptoms displayed on the user's body based on the voice conversation body information and environment information; A chemical substance estimation step of estimating a chemical substance exposed to the user's body based on the recognized symptom, and when the symptom is not determined in the symptom recognition step or the chemical substance is not determined in the chemical substance estimation step, the chemical substance estimation step A question generation step of generating a question to be output to the user may be included.

In addition, the information collection step is a voice conversation step of receiving symptoms appearing on the user's body through voice conversation between the terminal and the user, and generating body information by sensing the user's body by the terminal worn on the user's body. and a body sensing step of providing the information to the server, and an environment sensing step of generating environment information by sensing the environment where the user is located by a terminal worn on the user's body or a terminal disposed in the space where the user is located, and providing the environment information to the server. can do.

In addition, the voice conversation step can be performed through questions and answers between the terminal and the user, and the voice conversation starts while speaking the symptoms of the body recognized by the user to the terminal, or the body sensed by the terminal. The server may analyze the information or environment information and start by asking a user a question through the terminal by voice.

In addition, the symptom recognizing step is a first range determination step in which the server compares items and values included in the body information and environmental information with reference ranges according to the items and determines whether or not they are out of the standard range. A trend generation step of creating a trend with values collected in chronological order for each item included in the information and environment information, and comparing the expected range obtained using the trend with the items and values included in the body information and environment information , and a second range determination step of determining whether or not the expected range is out of the range.

In addition, the question generating step includes, when it is determined that the item is out of the range in the first range determination step or the second range determination step, generating a first type of question inquiring whether there is a symptom related to an item out of the range. can include

In addition, the symptom recognizing step may include a voice recognition step of generating a text sentence by recognizing a voice included in the voice conversation by the server, and a step of determining whether a symptom that can be expressed in language exists in the body of the user by analyzing the text sentence. 1 symptom determination step, a second symptom determination step of recognizing a non-verbal expression by analyzing the voice conversation and the text sentence and determining whether a symptom exists in the user's body, and the first symptom determination step or the second symptom determination step In case the symptom is recognized or the symptom is not recognized, a symptom confirmation step of determining whether the symptom exists may be included.

In addition, in the symptom recognizing step, when it is determined that the first range determination step or the second range determination step is out of range, prior to performing the question generation step, it is determined whether an item out of the range is included in an emergency category. The method may further include a determination step, and a symptom determination step of determining that a symptom related to the urgent item exists when an item out of the range is included in the emergency item in the item determination step.

In addition, the question generating step may include, when it is determined that the value of an item included in the body information and environment information is out of a predetermined range, generating a first type of question asking whether a symptom related to the item out of the range exists. , and generating a second type of question for confirming whether a symptom that is not expected to appear or a symptom that is expected to appear exists in relation to the chemical substance estimated using the symptom database in the chemical substance estimation step. can include

In addition, the chemical estimating step is to determine the chemical substance causing the symptoms appearing in the user's body by using a symptom database including a knowledge graph generated by learning the chemical substance and symptoms appearing when the chemical substance is exposed to the body. It may include a symptom-based estimation step of searching, and a determination step of determining one or more chemical substances with a high probability as the final exposed chemical substance when the number of substances estimated to be chemicals causing symptoms in the user's body is smaller than a reference number. there is.

A terminal performing a method for recognizing symptoms of a body and estimating chemical substances according to an embodiment of the present invention includes a voice input unit that receives information spoken by a user by voice, and a voice output unit that outputs a question to the user by voice. , and a control unit for controlling the voice input unit and the audio output unit to perform questions and answers with the user by voice and provide the information to the server.

In addition, when the server analyzes the user's body information or environment information and determines that the value of an item included in the body information and environment information is out of a predetermined range, symptoms related to the item outside the range exist. A first type of question asking whether a symptom is expected to appear in the server, and a second type of question asking whether a symptom that is not expected to appear or a symptom that is expected to appear exists in relation to the chemical substance estimated using the symptom database in the server. Any one of these may be included.

In addition, the answer may include an answer to the question or content for confirming whether or not a symptom exists in the user's body as the user's judgment.

A terminal performing a method for recognizing symptoms of a body and estimating chemicals according to an embodiment of the present invention includes a body sensor unit that senses the user's body to generate body information, and senses an environment in which the user is located. It may include an environment sensor unit that generates environment information, and a control unit that collects and provides the body information and environment information to a server.

In addition, the control unit may control the body sensor unit and the environment sensor unit to measure the body information and environment information at predetermined intervals, and to measure the body information and environment information at intervals shorter than the predetermined period while the question and answer are in progress.

In addition, the terminal may be implemented as a device that can be worn on the body, implemented as a robot that moves in a predetermined area, or implemented as a facility disposed in a predetermined space.

The server performing the method of recognizing symptoms of the body and estimating chemical substances according to an embodiment of the present invention includes the user's body information received from the terminal, environmental information of the environment in which the user is located, and the relationship between the user and the terminal. A symptom recognition unit that recognizes symptoms by analyzing voice conversations, a symptom database including a knowledge graph generated by learning chemicals and symptoms that appear when the chemical is exposed to the body, and generating symptoms recognized by the symptom recognition unit A substance estimator that searches and estimates the symptom database for chemicals to be ordered, and determines the final exposed chemicals in order of probability when the number of estimated chemicals is smaller than the reference number, and the symptom recognition unit detects symptoms A question generator may be included to generate a question to be output to the user when the determination is not made or the substance estimator fails to determine the chemical substance.

In addition, the symptom recognizing unit compares the items and values included in the body information and environmental information with a reference range or a predicted range predicted using a trend, and requests the question generator to generate a question when it is determined that it is outside the range. , It is possible to determine whether a symptom exists in the body by recognizing the voice conversation as a text sentence and determining whether there is a symptom that can be expressed in language or a symptom that can be recognized as a non-verbal expression.

In addition, the question generating unit analyzes the body information or environment information, and when it is determined that the value of an item included in the body information and environment information is out of a predetermined range, inquires whether there is a symptom related to the item out of range. Generating any one of a first type of question and a second type of question for confirming whether a symptom that is not expected to appear or a symptom that is expected to appear is present in relation to a chemical substance estimated using the symptom database can do.

According to one embodiment of the present invention, since body information and environment information are collected from a terminal worn on the body or a terminal installed in an industrial field, and symptoms are recognized by performing a voice conversation with a user, symptoms appearing on the body can be accurately recognized. Therefore, it is possible to more accurately estimate the chemical exposure of the body based on symptoms.

1 is a diagram showing an environment in which a method of recognizing a symptom of a body and estimating a chemical substance according to an embodiment of the present invention is performed.
2 is a diagram illustrating a terminal performing a method of recognizing a symptom of a body and estimating a chemical substance according to an embodiment of the present invention.
3 is a diagram illustrating a terminal and a server performing a method of recognizing a symptom of a body and estimating a chemical substance according to an embodiment of the present invention.
4 is a flowchart showing each step of a method of recognizing a symptom of a body and estimating a chemical substance according to an embodiment of the present invention.
5 is a diagram illustrating functions performed by a terminal and a server performing a method of recognizing a symptom of a body and estimating a chemical substance according to an embodiment of the present invention.
6 is a flowchart showing in detail the symptom recognition step in the method of recognizing symptoms of the body and estimating chemical substances according to an embodiment of the present invention.
7 is a flowchart showing in detail a chemical substance estimation step in a method for recognizing a symptom of a body and estimating a chemical substance according to an embodiment of the present invention.
8 is a diagram showing a knowledge graph of a symptom database used in a method for recognizing a symptom of a body and estimating a chemical substance according to an embodiment of the present invention.

Objects, specific advantages and novel features of an embodiment of the present invention will become more apparent from the following detailed description and preferred embodiments taken in conjunction with the accompanying drawings. In adding reference numerals to components of each drawing in this specification, it should be noted that the same components have the same numbers as much as possible, even if they are displayed on different drawings. In addition, terms such as "one side", "the other side", "first", and "second" are used to distinguish one component from another, and the components are not limited by the above terms. no. Hereinafter, in describing an embodiment of the present invention, a detailed description of related known technologies that may unnecessarily obscure the subject matter of an embodiment of the present invention will be omitted.

Hereinafter, with reference to the accompanying drawings, an embodiment of the present invention will be described in detail.

1 is a diagram showing an environment in which a method of recognizing a symptom of a body and estimating a chemical substance according to an embodiment of the present invention is performed. 2 is a diagram showing a terminal 100 performing a method of recognizing a symptom of a body and estimating a chemical substance according to an embodiment of the present invention. 3 is a diagram illustrating a terminal 100 and a server 200 performing a method of recognizing a symptom of a body and estimating a chemical substance according to an embodiment of the present invention.

In this specification, the terminal 100 that performs the method of recognizing symptoms of the body and estimating chemicals can be simply described as 'terminal 100', and performs the method of recognizing symptoms of the body and estimating chemicals. The server 200 that does can be simply described as 'server 200'. In this specification, a chemical substance may include substances that cause symptoms when exposed to the body, substances that may harm the body, and various other chemical substances.

See Figures 1, 2, and 3. When certain chemicals and the user 10 are present in one place, there may be a risk that the user 10 is exposed to the chemicals. For example, chemical substance A, chemical substance B, chemical substance C and the user 10 may exist in place A. When the user 10 is exposed to chemical substance A, symptoms caused by chemical substance A may occur in the body of the user 10 . Symptoms include reactions in the body of the user 10, and may include various symptoms such as odor, fever, stinging eyes, shortness of breath, increased heart rate, flames, smoke, visually confirmed container damage or leakage. The influence on the surrounding environment 40 may also be included.

The user 10 may perform a voice conversation with the terminal 100 disposed in place A, and input symptoms appearing in the body to the terminal 100 . The terminal 100 may transmit a voice conversation to the server 200 through the network 20 . The terminal 100 may sense the body of the user 10 to generate body information and provide it to the server 200 . The body information may include body temperature, blood pressure, pulse, electromyography, and the like. The terminal 100 may sense the environment 40 of the place where the user 10 is located to generate environment information and provide it to the server 200 . Environmental information may include temperature, humidity, atmospheric pressure, gas leakage, smoke generation, vibration, and inclination. The server 200 may estimate what chemicals the user 10 is exposed to by analyzing voice conversations, body information, and environmental information.

The server 200 may provide information on the estimated chemical substance to the terminal 100 and the responding agency 30, and the terminal 100 may provide the user 10 with a voice message to the chemical substance the user 10 is exposed to. The type of substance, response method, etc. can be informed. The response agency 30 may include a fire station, a hospital, a police station, a ward office, a city hall, other administrative agencies, managers of industrial sites, and the like necessary to cope with a chemical leakage accident.

In general, since each chemical causes the same or different symptoms, and it is impossible for the user 10 to know the symptoms for all chemicals, it is very difficult for the user 10 to immediately determine which chemical he or she has been exposed to. difficult. According to one embodiment of the present invention, even if the user 10 does not know what chemical substance he has been exposed to, by performing a voice conversation with the terminal 100, the user 10 will be guided to the type of chemical substance to which he is exposed, how to respond, and the like. can

A plurality of terminals 100 may be disposed in one place. For example, terminal 100 A and terminal 100 B may be disposed in place A. The place may include various places such as industrial facilities, construction sites, laboratories, and multi-use facilities. The server 200 may analyze voice conversations, body information, and environmental information provided from a plurality of terminals 100 respectively disposed in a plurality of locations, recognize symptoms, and estimate chemical substances. The terminal 100 and the server 200 may be directly connected by wire or wireless, or connected through a wired or wireless network 20 .

See Figure 2. The terminal 100 may be implemented as a device wearable on the body, implemented as a robot that moves in a predetermined area, or implemented as equipment disposed in a predetermined space. The terminal 100 may include a wearable terminal 100A that can be worn on the body. The wearable terminal 100A may include a helmet terminal 100A1, a vest terminal 100A2, and a smart watch terminal 100A3. The wearable terminal 100A may be implemented in various forms such as belts, necklaces, glasses, and shoes. The terminal 100 may include a non-wearable terminal 100B. The non-wearable terminal (100B) is a fixed type including facilities such as air purifiers, humidifiers, air conditioners, etc., which are placed in designated places in industrial sites, or existing facilities such as gas sensors and temperature sensors installed on the walls of industrial sites. It may be implemented in the form of a mobile terminal 100B2, such as a terminal 100B1, a robot or a drone that moves on a predetermined path or autonomously.

See FIG. 3 . The terminal 100 performing the method of recognizing symptoms of the body and estimating chemical substances according to an embodiment of the present invention includes a voice input unit 110 that receives information spoken by a user 10 by voice, and a user 10 ) to a voice output unit 120, and a voice input unit 110 and a voice output unit 120 to perform questions and answers with the user 10 by voice and provide them to the server 200. It may include a control unit 130 for controlling. In addition, the terminal 100 includes a body sensor unit 150 that senses the body of the user 10 to generate body information, and an environment sensor unit that senses the environment 40 in which the user 10 is located to generate environment information. (140). The terminal 100 is connected to the server 200 through the network 20, and the terminal communication unit 160 transmits and receives data. A terminal storage unit 170 for storing program codes and other data may be included.

The voice input unit 110 may include a microphone. The voice input unit 110 may convert a sentence input as voice by the user 10 into an electrical signal. The control unit 130 may provide the voice input through the voice input unit 110 to the server 200 through the terminal communication unit 160 . The audio output unit 120 may include a speaker. The control unit 130 may convert the question or notification received from the server 200 into voice through the audio output unit 120 and provide it to the user 10 .

Here, the question is, when the server 200 analyzes the body information or environment information of the user 10 and determines that the value of an item included in the body information and environment information is out of a predetermined range, the item outside the range. In relation to a first type of question inquiring whether there are symptoms related to, and a chemical substance estimated using the symptom database 250 in the server 200, there are symptoms that are not expected to appear or symptoms that are expected to appear It may include any one of the second type of questions confirming whether or not.

Here, the answer is an answer to a question or a judgment of the user 10, and may include content confirming whether symptoms exist in the body of the user 10. In response to the question of the terminal 100, the user 10 may answer whether symptoms exist in the body. The user 10 may tell the terminal 100 that a symptom exists in the body according to the user 10's own judgment even if the terminal 100 does not ask a question. The terminal 100 provides an answer input from the user 10 to the server 200, and the server 200 analyzes the answer to recognize the existence of symptoms and performs a process of estimating a chemical substance that causes the symptoms. can start

The environment sensor unit 140 may include one or more sensors. Sensors included in the environment sensor unit 140 may include various types of sensors such as a gas sensor, a smoke sensor, a camera, a microphone, a temperature sensor, an optical sensor, a pressure sensor, and a vibration sensor. The environment sensor unit 140 may monitor a place where the terminal 100 is located. The environment sensor unit 140 provides the measured value of the sensor to the control unit 130 . The control unit 130 may detect a change in the environment 40 of the place through a measurement value received from the environment sensor unit 140 .

The control unit 130 may provide information about the change to the server 200 when the change recognized by the environmental sensor unit 140 is out of a predetermined range. For example, when the measured value of the gas sensor included in the environmental sensor unit 140 is higher than a predetermined value, it is recognized that a change has occurred and the type of sensor (gas sensor) and measured value information can be provided to the server 200. there is.

The body sensor unit 150 may include one or more sensors. Sensors included in the body sensor unit 150 may include a temperature sensor, a blood pressure sensor, an EMG sensor, a pulse sensor, a pressure sensor, and the like. The body sensor unit 150 may monitor the state of the user 10 . The environment sensor unit 140 provides the measured value of the sensor to the control unit 130 . The control unit 130 may detect a change in the state of the body through a measurement value received from the body sensor unit 150 .

The controller 130 may provide information about the change to the server 200 when the change recognized by the body sensor unit 150 is out of a predetermined range. For example, if the body temperature of the user 10 measured by the temperature sensor included in the body sensor unit 150 is higher than a predetermined value, it is recognized that a change has occurred, and the type of sensor (temperature sensor) and the measurement value are sent to the server 200. Value information can be provided.

The controller 130 may control the body sensor unit 150 and the environment sensor unit 140 to measure body information and environment information at predetermined cycles, and during questions and answers, at intervals shorter than the predetermined cycle. . The controller 130 may control the terminal 100 to generate body information and environmental information at predetermined intervals and provide them to the server 200 . If the terminal 100 is performing a voice conversation, the controller 130 may generate body information and environment information at a shorter cycle than a predetermined cycle and provide the generated body information and environment information to the server 200 . The fact that the voice conversation is in progress means that a change has occurred in the environment 40 or the body. Accordingly, the control unit 130 frequently measures body information and environmental information and provides the information to the server 200, thereby helping to recognize symptoms or estimating chemicals, and increasing the accuracy of estimating chemicals.

The terminal 100 includes at least one of a voice input unit 110, a voice output unit 120, a body sensor unit 150, and an environment sensor unit 140, a control unit 130, a terminal communication unit 160, and terminal storage. A portion 170 may be included. The wearable terminal 100A that can be worn on the body may include a body sensor unit 150, a control unit 130, a terminal communication unit 160, and a terminal storage unit 170, and may include a voice input unit 110 and a voice output unit. (120) may be further included. The wearable terminal 100A may be worn on the body, sense the body using the body sensor unit 150 to generate body information, and generate a voice conversation by talking to the user 10 . The wearable terminal 100A may further include an environment sensor unit 140 to sense the environment 40 where the user 10 is located to generate environment information.

Among the non-wearable terminals (100B), the fixed terminal (100B1) installed in a designated place is an environmental sensor unit (140) in existing sensors such as air purifiers, humidifiers, and air conditioners, or gas sensors and temperature sensors installed on walls. , A control unit 130, a terminal communication unit 160, and a terminal storage unit 170 may be further included. The fixed terminal 100B1 may further include an audio input unit 110 and an audio output unit 120 . The fixed terminal 100B1 may generate environment information by sensing the environment 40 of a predetermined place, and may generate a voice conversation by conversing with the user 10 entering the predetermined place.

Among the non-wearable terminals 100B, the mobile terminal 100B2 may include a robot moving along a predetermined path, a drone, or a robot autonomously traversing a predetermined space. The mobile terminal 100 may further include an environment sensor unit 140, a control unit 130, a terminal communication unit 160, and a terminal storage unit 170. The mobile terminal 100 may further include an audio input unit 110 and an audio output unit 120 . The mobile terminal 100 can create a voice conversation by conversing with the user 10 while moving, or can generate environment information by sensing the environment 40 of the moving place.

The server 200 performing the method of recognizing symptoms of the body and estimating chemical substances according to an embodiment of the present invention includes the body information of the user 10 received from the terminal 100, the location of the user 10 The symptom recognition unit 210 for recognizing symptoms by analyzing the environment information of the environment 40 and the voice conversation between the user 10 and the terminal 100, learning chemicals and symptoms that appear when the body is exposed to chemicals The symptom database 250 including the generated knowledge graph, and chemicals that cause the symptoms recognized by the symptom recognition unit 210 are searched and estimated from the symptom database 250, and the number of estimated chemicals is the reference number If it is smaller than the probability, it may include a substance estimator 230 for determining the finally exposed chemical in order of high probability.

The symptom recognizing unit 210 compares the items and values included in the body information and environmental information with a reference range or a predicted range predicted using a trend, and when it is determined that the range is out of range, the question generator 220 generates a question. It is possible to determine whether a symptom exists in the body by requesting a voice conversation as a text sentence and determining whether there is a symptom that can be expressed in language or a symptom that can be recognized as a non-verbal expression.

The question generation unit 220 analyzes the body information or environment information, and when it is determined that the value of an item included in the body information and environment information is out of a predetermined range, a system for inquiring whether there is a symptom related to the item out of the range. In relation to the chemical substance estimated using the first type question and the symptom database 250, any one of the second type questions confirming whether there is a symptom that is not expected to appear or a symptom that is expected to appear is present. can create

In addition, the server 200 according to an embodiment of the present invention includes a notification providing unit 240 that delivers information on the chemical substance determined by the substance estimation unit 230 to the terminal 100 or the corresponding institution 30, A server communication unit 260 connected to the terminal 100 through the network 20 to transmit and receive data, program code and other data necessary for the server 200 to perform a method of recognizing symptoms of the body and estimating chemical substances A server storage unit 270 for storing may be further included. Program codes necessary to perform the method of recognizing symptoms of the body and estimating chemical substances are driven by the processor, and the symptom recognition unit 210, structure analysis unit, substance estimation unit 230, notification providing unit 240 ) can be implemented.

4 is a flowchart showing each step of a method of recognizing a symptom of a body and estimating a chemical substance according to an embodiment of the present invention.

See FIG. 4 . A method for recognizing a symptom of a body and estimating a chemical substance according to an embodiment of the present invention is a voice conversation generated by a terminal 100 and a user 10 talking by voice, and a terminal 100 using a user 10 The information collection step (S10) of providing the body information generated by sensing the body of the user and the environment information generated by sensing the environment 40 in which the user 10 is located to the server 200 (S10), the server 200 Symptom recognition step (S20) of recognizing symptoms appearing on the body of the user 10 based on body information and environmental information, and chemical substances exposed to the body of the user 10 based on the symptoms recognized by the server 200 If the symptom is not determined in the estimated chemical substance estimation step (S30) and the symptom recognition step (S20) or the chemical substance is not determined in the chemical substance estimation step (S30), a question to be output to the user 10 is asked. A question generating step (S50) may be included. In addition, in the method for recognizing symptoms of the body and estimating chemicals according to an embodiment of the present invention, information on the chemical substances estimated in the chemical substance estimation step (S30) is transmitted to the user 100 through the terminal 100. ) It may further include a notification step (S30) provided.

5 is a diagram illustrating functions performed by a terminal 100 and a server 200 performing a method of recognizing a symptom of a body and estimating a chemical substance according to an embodiment of the present invention.

See Figures 3, 4, and 5. The information collection step (S10) is a voice communication step (S11) of receiving symptoms appearing on the body of the user 10 through voice communication between the terminal 100 and the user 10, A body sensing step (S12) in which the terminal 100 senses the body of the user 10 to generate body information and provides it to the server 200, and the terminal 100 worn on the body of the user 10 or the user ( 10) may include an environment sensing step (S13) in which the terminal 100 disposed in the space where the user 10 is located senses the environment 40 where the user 10 is located to generate environment information and provide it to the server 200.

The body sensing step ( S12 ) may be performed through the wearable terminal 100A worn by the user 10 . In the body sensing step (S12), the terminal 100 worn on the body of the user 10 senses the body of the user 10 using the body sensor unit 150 included in the terminal 100, and the measured data Body information including may be generated and the body information may be provided to the server 200 . For example, in the body sensing step (S12), the terminal 100 may measure the body temperature of the user 10, include it in body information, and provide it to the server 200.

The environment sensing step (S13) may be performed through a wearable terminal 100A worn by the user 10 or a fixed terminal 100B1 installed in the environment 40 where the user 10 is located. . In the body sensing step (S12), the stationary terminal 100B1 senses the environment 40 of the place where the user 10 is located using the environment sensor unit 140 included in the terminal 100, and includes the measured data. It is possible to generate environment information to be used and provide the environment information to the server 200 . For example, in the environment sensing step ( S13 ), the terminal 100 may measure the gas leaked in the place where the user 10 is located, include it in environment information, and provide the information to the server 200 .

The voice conversation step (S11) includes questions and answers exchanged by voice between the user 10 and the terminal 100. The terminal 100 may receive information on bodily symptoms from the user 10 as voice input, and may output a question asking the user 10 whether or not there are bodily symptoms.

The voice conversation step (S11) may be performed through questions and answers between the terminal 100 and the user 10, and the user 10 speaks the symptoms of the body he/she recognizes to the terminal 100 by voice, and the voice conversation starts, or the server 200 analyzes the body information or environment information sensed by the terminal 100 and may start by asking a question to the user 10 through the terminal 100 by voice.

The user 10 may start a conversation by first telling the terminal 100 about his symptoms. When the user 10 is exposed to a chemical substance, the user 10 may be aware of the symptoms appearing in the body, and the user 10 inputs the symptoms he/she is aware of into the terminal 100 by voice to the terminal ( 100) to start a conversation. For example, the user 10 may tell the terminal 100 the symptoms of itchy eyes and a headache through voice.

When the user 10 inputs a symptom into the terminal 100 as a voice, the voice input unit 110 of the terminal 100 may receive the user's 10 voice and provide it to the control unit 130 . The controller 130 may provide voice to the server 200 through the terminal communication unit 160 . The server 200 may perform a symptom recognition step of recognizing a symptom from the voice received from the terminal 100 (S20) and a chemical substance estimation step of estimating a substance based on the recognized symptom (S30).

The terminal 100 may start a conversation by asking the user 10 whether symptoms exist. The body sensor unit 150 or the environment sensor unit 140 of the terminal 100 measures the body of the user 10 and the environment 40, and when a value exceeding a predetermined range is measured, the control unit 130 detects a state change. It can inform the server 200 that it has occurred. Alternatively, the terminal 100 provides body information and environmental information to the server 200, and the server 200 analyzes the body information and environment information to ask the user through the terminal 100 a question requesting confirmation of symptoms. (10) can be provided. The server 200 may create and provide a question to the terminal 100 asking whether there is a symptom related to the state change, and the terminal 100 may output the question to the user 10 as a voice.

The sensor included in the terminal 100 may detect a leaked chemical substance at a low concentration before it causes symptoms in the human body, or it may first detect the symptoms appearing in the human body. Although the user 10 has been exposed to chemicals, there is a possibility that he or she may not be aware of symptoms of the body. In this case, when the terminal 100 first asks the user 10 about physical symptoms, the user 10 may know the possibility of chemical leakage and have an opportunity to pay attention to whether there are physical symptoms. Therefore, starting a conversation while the terminal 100 first asks the user 10 whether symptoms exist by voice has a useful effect in itself.

When the terminal 100 starts a voice conversation first, the user 10 replies to the terminal 100, and the terminal 100 provides an answer to the server 200, the server 200 performs the symptom recognition step (S20). ) and chemical substance estimation step (S30) can be performed.

Regardless of whether the terminal 100 starts the voice conversation first or the user 10 starts the voice conversation first, the server 200 performs the symptom recognition step (S20) and the chemical substance estimation step (S30), If additional confirmation of the symptom is required, the voice conversation can be continued by creating a new question. The voice conversation may be repeatedly performed until the substance estimation unit 230 of the server 200 determines the chemical substance.

6 is a flowchart showing in detail the symptom recognition step in the method of recognizing symptoms of the body and estimating chemical substances according to an embodiment of the present invention.

See Figures 3, 4, and 6. In the symptom recognition step (S20), the symptom recognition unit 210 of the server 200 analyzes the body information, environment information, and voice conversation received from the terminal 100 to recognize symptoms appearing in the body of the user 10. It is a process of The symptom recognition step (S20) is a first range determination step (S21) in which the server 200 compares the items and values included in the body information and environmental information with the reference range according to the item, and determines whether or not it is out of the standard range. (200) a trend generation step (S22) of creating a trend with values collected in chronological order for each item included in the body information and environment information, and the expected range obtained using the trend and the items included in the body information and environment information It may include a second range determination step (S23) of comparing the value and determining whether it is out of the expected range.

The first range determination step (S21) is a process of comparing a value included in body information or environment information with a reference range stored in the server storage unit 270. In the first range determination step (S21), the symptom recognition unit 210 determines the body temperature, heart rate, blood pressure, etc. items and their values included in the body information, the reference range of the body temperature, the reference range of the heart rate, and the reference range of the blood pressure. can be compared with The symptom recognizing unit 210 may compare items and their values included in environmental information, such as temperature, carbon dioxide concentration, and combustible gas concentration, with reference ranges of temperature, carbon dioxide concentration, and combustible gas concentration. . The reference range includes an upper limit value and a lower limit value, and when the upper limit value is exceeded or the lower limit value is less than the lower limit value, it may be determined that the reference range is deviated. When the symptom recognizing unit 210 determines that any one of the values included in the body information or the environment information is out of the reference range in the first range determination step (S21) (Y), the question generation step (S50) is performed. Items and values in which a deviation from the standard range has occurred may be provided to the question generator 220 . The symptom recognizing unit 210 may continue to perform the information collection step (S10) when it is determined in the first range determination step (S21) that all values included in the body information or environmental information do not deviate from the reference range (N). there is.

The trend generation step (S22) is a process of generating a trend by using regression analysis of values collected in chronological order for each item included in the body information and environment information. A trend may be generated for each item included in the body information and environment information to indicate a value trend. There may be various specific methods for generating trends. For example, regression analysis, moving average, etc. can be used. Trends created using body information reflect the physical characteristics of the user 10 because they are created using values collected by sensing the body of the user 10 . Accordingly, trends may be generated differently for each user 10 . Trends generated using environmental information may reflect the characteristics of the environment 40 that change according to processes. Trends may be generated for each item of body information such as body temperature, heart rate, blood pressure, and the like, and environmental information such as temperature and carbon dioxide concentration.

The second range determination step (S23) is a process of obtaining an expected range of body information or environment information by using a trend, and comparing currently measured values of body information and environment information. For example, in the second range determination step ( S23 ), the symptom recognizing unit 210 may compare the expected range obtained using the body temperature trend with the current body temperature. The expected range may be set narrower than the standard range. The reference range is determined as a range in which symptoms can appear in the body, regardless of individual differences or process differences, and the expected range may be determined as a range in which it can be determined that a rapid change has occurred in light of existing records. For example, the reference range is a range in which symptoms usually appear in the body when deviating, and the expected range is a range that can be recognized as a rapid change in body temperature in light of a specific individual's body temperature record. Expected ranges can be set at 5% or 10% above and below the trend value. Alternatively, the expected range may be set to a value corresponding to 2 sigma after standard normal distribution of the trend.

In the second range determination step ( S23 ), when the current body temperature is out of the expected range, it may be determined that the expected range has occurred. When the symptom recognizing unit 210 determines that any one of the values included in the body information or environment information is out of the expected range in the second range determination step (S23) (Y), the question generation step (S50) is performed. Items and values that deviate from the expected range may be provided to the question generator 220 . The symptom recognizing unit 210 may continue to perform the information collection step (S10) when it is determined in the second range determination step (S23) that all values included in the body information or environment information do not deviate from the expected range (N). there is.

Since the expected range is a value obtained by using a trend, the characteristics of a person are reflected. Since the first user 10 moves his body due to the nature of his work, his body temperature can be measured relatively high, and the second user 10's body temperature can be measured relatively low because he is sitting due to the nature of his work. In this way, the same item may indicate different values according to the user 10 . If the reference range is set narrowly in the first range determination step (S21), the difference according to the user 10 may be mistakenly recognized as a symptom. The symptom recognizing unit 210 may use the first range determination step S21 and the second range determination step S23 together to minimize misreading and recognize the presence or absence of symptoms according to the characteristics of the user 10's body. there is.

In the symptom recognition step (S20), if it is determined to be out of range in the first range determination step (S21) or the second range determination step (S23), prior to performing the question generation step (S50), an item out of the range is an urgent item. The item determination step (S24) of determining whether it is included in the item determination step (S24) and the symptom determination step (S28) of determining that the symptoms related to the emergency item exist when an item out of range in the item determination step (S24) is included in the emergency item are further performed. can include

The item determination step (S24) is a process of determining whether the item determined to be out of range in the first range determination step (S21) or the second range determination step (S23) is included in the critical category. The item determination step (S24) may be performed by the symptom recognizing unit 210. The item determination step (S24) may be performed when the item is out of the reference range in the first range determination step (S21). The item determination step (S24) may be performed when the item is out of the expected range in the second range determination step (S23). Urgent items may include items that cause serious symptoms in the body. Critical items may include heart rate, oxygen saturation, lowering of blood pressure, and the like. In the item determination step (S24), if the item determined to be out of range corresponds to an emergency item (Y), the symptom confirmation step (S28) may be performed.

The symptom confirmation step (S28) is a process of determining that a symptom related to the emergency item exists when a deviation from the range occurs in an item corresponding to the emergency item and the value corresponds to the emergency reference value. If an item included in body information or environmental information is included in an emergency item and the value of the item corresponds to the emergency standard value of the emergency item, it is difficult to determine symptoms through voice conversation or a serious risk to the body has occurred. It can be confirmed that the symptom has occurred. For example, the heart rate may correspond to an emergency item, and if the emergency reference value of the heart rate, which is an emergency item, is 0 and the current heart rate is 0, the symptom may be determined as having occurred in the symptom determination step. In the item determination step (S24), when the value of the item out of the range does not correspond to the emergency reference value (N), the question generation step (S50) may be performed.

In the question generating step (S50), when it is determined that the value of the item included in the body information and the environmental information is outside the predetermined range, generating a first type of question asking whether there is a symptom related to the item out of the range ( S51), and in relation to the chemical substance estimated using the symptom database 250 in the chemical substance estimation step (S30), a second type of confirming whether there is a symptom that is not expected to appear or a symptom that is expected to appear. It may include generating a question of (S52).

The question generating step (S50) may be performed by the question generating unit 220. In the question generating step (S50), a question may be generated to request the user 10 to confirm whether or not there is a symptom. The question generated in the question generation step ( S50 ) is provided to the terminal 100 , and the audio output unit 120 of the terminal 100 may output the question to the user 10 through voice.

The step of generating a first type of question (S51) generates a question for confirming whether or not there is a symptom related to an item determined to be out of range in the first range determination step (S21) or the second range determination step (S23). can do. The question generating unit 220 may refer to a table of symptoms and items stored in the storage unit to obtain symptoms related to items out of range. One symptom may be accompanied by changes in various items. When both the body temperature and heart rate items are out of range, the question generating unit 220 may preferentially select symptoms accompanying changes in body temperature and heart rate items from among various symptoms stored in the storage unit. The question generating unit 220 may generate a question asking the user 10 whether the selected symptoms exist.

Items included in the body information and environment information are values such as body temperature, heart rate, blood pressure, temperature, carbon dioxide concentration, gas leakage, etc., and it is difficult to directly determine whether any symptoms appear in this environment 40. . Accordingly, in one embodiment of the present invention, when an item out of range occurs, the user 10 is questioned about the presence or absence of symptoms, and the symptoms appearing in the body are recognized by analyzing the answer.

When a question of the first type is generated in the question generation step (S50) and the question is provided to the user 10 through the terminal 100, the user 10 may answer whether symptoms exist in the body as an answer to the question. can Through this process, the information collection step (S10) is performed, and a voice conversation can be created.

The symptom recognition step (S20) is a voice recognition step (S25) in which the server 200 recognizes the voice included in the voice conversation and generates a text sentence (S25), and the symptoms that can be expressed in language are the user 10's body by analyzing the text sentence A first symptom determination step (S26) of determining whether there is a symptom in the body, a second symptom determination step (S27) of recognizing a non-verbal expression by analyzing voice conversations and text sentences, and determining whether symptoms exist in the body of the user 10 (S27), and In the first symptom determination step (S26) or the second symptom determination step (S27), a symptom determination step (S28) of determining whether a symptom exists or not may be included when the symptom is recognized or the symptom is not recognized.

The voice recognition step (S25) is a process of generating text sentences from voice conversations using STT (Sound To Text) technology. In the voice recognition step (S25), the symptom recognition unit 210 may convert the received voice conversation into a text sentence.

The first symptom determination step (S26) is a process of determining whether a symptom exists in the body of the user 10 by analyzing the voice conversation. The symptom recognizing unit 210 may extract words related to symptoms included in text sentences. The symptom recognizing unit 210 may recognize expressions of various users 10 as expressing specific symptoms. When the user 10 expresses a symptom appearing in the body, each user 10 may use a different word. In this case, the symptom recognizing unit 210 may recognize a specific symptom even if the user 10 describes the symptom displayed on the body in various expressions. The symptom recognizing unit 210 may recognize one or more symptoms described by the user 10 , respectively. For example, if expressions such as 'dizziness' or 'fever' exist in the text sentence, it may be determined that the corresponding symptom exists in the body of the user 10 . If expressions such as 'no abnormality' or 'no fever' exist in the text sentence, it may be determined that the corresponding symptom does not exist in the body of the user 10 .

The second symptom determination step (S27) is a process of determining whether a symptom recognizable as a non-verbal expression exists in the body of the user 10 by analyzing the voice conversation. In the second symptom determination step S27, the symptom recognition unit 210 may determine whether voice is not recognized, questions are not answered, sentences are interrupted, or non-verbal expressions such as screaming exist. If such a non-verbal expression exists in the second symptom determination step S27, it may be determined that the user 10 has a symptom related to the non-verbal expression. Symptoms associated with non-verbal expression may include paralysis, fainting, and difficulty breathing.

The symptom determination step (S28) is a process of determining whether a symptom exists or not by integrating the symptoms recognized in the first symptom determination step (S26) or the symptoms recognized in the second symptom determination step (S27). In the first symptom determination step ( S26 ), the symptom determined to be non-existent or present is based on the judgment of the user 10, so the symptom can be determined as it is. It is difficult to clearly determine which symptom is the symptom determined to exist in the second symptom determination step S27 recognized as a non-verbal expression. Therefore, it can be determined that a symptom that can occur together with the symptom determined to exist in the first symptom determination step (S26) exists.

7 is a flowchart showing in detail a chemical substance estimation step in a method for recognizing a symptom of a body and estimating a chemical substance according to an embodiment of the present invention.

The chemical substance estimating step (S30) may be performed by the substance estimating unit 230. In the chemical substance estimation step (S30), symptoms appearing on the body of the user 10 are determined by using the symptom database 250 including a knowledge graph generated by learning chemicals and symptoms that appear when the body is exposed to the chemicals. A symptom-based estimation step of searching for a chemical substance causing symptoms (S31), and when the number of substances estimated to be chemicals causing symptoms in the body of the user 10 is smaller than the reference number, one or more chemicals with high probability are selected as final exposure chemicals. It may include a determination step (S33) of determining the material.

The symptom-based estimating step (S31) is a process of searching for a chemical substance capable of causing a corresponding symptom based on a symptom recognized as appearing on the body of the user 10.

8 is a diagram showing a knowledge graph of a symptom database 250 used in a method for recognizing a symptom of a body and estimating a chemical substance according to an embodiment of the present invention.

See Figures 2, 7, and 8. The symptom database 250 of the server 200 may include a knowledge graph generated by learning chemicals and symptoms. Symptoms include changes in the body that occur when the body is exposed to a chemical. Chemicals and their associated symptoms can be formed by learning previously published databases. The data that the symptom database 250 learns is, for example, material safety data sheet (MSDS) provided by the Korea Occupational Safety and Health Agency, Hazardous Substance Data (HSDB) included in the US NIH's WISER (Wireless Information System for Emergency Responders) Bank), databases open to the public by the US National Institute for Occupational Safety and Health (NIOSH).

The symptom database 250 of the server 200 includes, for example, chemicals (chemical substances A, B, C, and D) and related symptoms (symptoms A, B, . .. I) may have a form in which each relational value (relational value AA, AB, ... DI) is connected. Since one chemical substance can show multiple symptoms, one chemical substance can be connected with multiple symptoms through relational values. Since one symptom can be manifested by various chemicals, one symptom can be connected to multiple chemicals through relational values. In FIG. 8, the relationship value is shown as a line connecting the chemical substance and the symptom, and various methods can be used to display the relationship value. In this specification, the relationship value indicated as relationship value AB is symptom B caused by chemical substance A. It is exemplarily defined and explained to mean.

If there is a relationship value between a chemical substance and a symptom, it can be judged that there is a symptom caused by a chemical substance in the body. The relational value may include various information such as the amount of a chemical substance to be exposed to cause symptoms, the fatality of symptoms occurring when exposed to a chemical substance, and the order in which symptoms occur when exposed to a chemical substance.

When a symptom is input from the symptom recognizing unit 210, the substance estimator 230 may perform a symptom-based estimating step S31 of searching for the corresponding symptom in the symptom database 250. The symptom-based estimation step (S31) is a process of searching for a chemical substance that causes a symptom appearing in the body of the user 10. First, chemical substances connected through the entered symptoms and relationship values are searched. For example, when symptom A is input from the symptom recognizing unit 210, chemicals (chemical substances A, B, C, and D) that can cause symptom A are searched for.

Next, the substance estimator 230 may perform a judgment step (S33) of determining whether it is appropriate to finally output the retrieved chemical substances as chemical substances exposed to the user 10. In the determination step (S33), the substance estimation unit 230 may determine based on whether the number of searched chemicals is greater than the reference number. There may be a variety of chemicals that produce any symptom, and the required response may be different. Therefore, outputting too many chemicals can make it difficult to respond. Therefore, the reference number can be set to a number small enough for the user 10 to respond to the chemical substance. For example, if the standard number is 2 and the searched chemicals are 4 of A, B, C, and D, in the determination step (S33), the substance estimator 230 determines that the searched chemicals are chemicals exposed to the user 10. It can be determined that it is difficult to estimate (N).

When it is determined (N) that it is difficult to estimate that the chemical substance retrieved in the determination step (S33) is a chemical substance exposed to the user 10, the question generation step (S50) may be performed. In the question generating step (S50), the step of generating the second type of question (S52) may be performed. The second type of question is transmitted to the terminal 100, and the terminal 100 outputs the question to the user 10 through voice to perform a voice conversation. In the step of generating the second type of question, when the chemical substance exposed to the body of the user 10 is not determined in the determination step S33, a question for estimating the chemical substance exposed to the body of the user 10 is generated. and provided to the terminal 100. The question generating step (S50) may be performed by the question generating unit 220.

The question generating unit 220 may search for other symptoms indicated by the searched chemicals and generate a question asking the user 10 whether one or more of the other symptoms exist. For example, symptoms caused by chemicals A, B, C, and D in the body can be retrieved as having symptoms A, B, ... I. Among the searched symptoms, a question asking whether symptom E exists may be generated. At this time, if the user 10 answers that symptom E exists, chemicals C and D may be excluded, and the user 10 If the answer is that symptom E does not exist, chemicals A and B can be excluded. In this way, the question generation unit 220 may generate a question inquiring about symptoms that may occur to the user 10 in the question generation step (S50). The question is provided to the terminal 100 through the server communication unit 260, and the terminal 100 provides the user 10 with the question as a voice so that the voice communication step (S11) can be performed again. When the voice communication step (S11) is performed and an answer is received from the user 10, the symptom recognition step (S20), the symptom-based estimation step (S31), the judgment step (S33), the question generation step (S50), or substance determination are performed again. Step S33 may be performed.

If the symptom recognition step (S20), the symptom-based estimation step (S31), the judgment step (S33), the question generation step (S50) are performed and the voice conversation step (S11) is repeated, the user's body (10) The presence or absence of symptoms can be repeatedly judged, and the scope of chemicals can be narrowed down continuously. For example, when symptom A appears to the user 10 in the symptom recognition step (S20), chemical substances A, B, C, and D are estimated, and when symptom E is recognized to exist through a question, chemical substance C, D can be excluded from the presumed substances.

By repeating this process, it is possible to filter the number of chemicals retrieved in the symptom-based estimation step (S31) to be smaller than the reference number.

In the determination step (S33), if the number of substances determined to be chemical substances exposed to the user 10 is smaller than the reference number, it is determined that the searched chemical substance is a chemical substance exposed to the user 10 (Y), and the substance is determined. Step S33 may be performed. In the substance determination step S33 , one or more chemical substances may be determined in order of a high probability of being exposed to the user 10 from among the searched chemical substances. The probability of exposure to the user 10 may be determined by factors such as whether the chemical substance is used in the environment 40 in which the user 10 is located, the frequency of use of the chemical substance, and the work of the user 10 . The determined chemical substance may be provided to the notification provider 240 . The notification provider 240 may provide the terminal 100 or the responding institution 30 with the determined type of chemical substance, response method, and other necessary information.

By performing this process, the user 10 inputs symptoms appearing in his/her body through voice to the terminal 100, and the server 200 determines the user 10's body based on the symptoms input by the user 10. It is possible to determine which substances are presumed to have been exposed to. Since the user 10 communicates with the terminal 100 using voice, he or she can conveniently input symptoms and receive a response method.

Refer back to FIGS. 6 and 7 . In the step of generating a second type of question (S52) of the question generating step (S50), a symptom that is not expected to appear or a symptom that is expected to appear exists using the symptom database 250 and the structure database 260. You can create a question to see if it does or not.

The step of generating the second type of question (S52) is performed when the number of searched chemicals is greater than the reference number (N) as a result of performing the symptom-based estimation step (S31) and performing the judgment step (S33). It can be. That is, if too many chemicals are searched, additional queries may be performed if needed to improve accuracy.

In the step of generating the second type of question ( S52 ), a place where the user 10 is located, a list of chemical substances related to the place, a weight based on a recent record, and a change in process may be considered in the process of generating the question. If the location where the user 10 is located and the chemical substance included in the list of chemical substances related to that place match the chemical substance searched for by the substance estimation unit 230, the presence or absence of the chemical substance may be first asked. can In the recent record, which chemicals were used are recorded, and questions can be asked in the order of recently used chemicals. When there is a change in the process at the place where the user 10 is located, the change in environmental information according to the change may be considered.

As a result of performing the symptom-based estimating step (S31), the substance estimator 230 may obtain a plurality of chemicals, a plurality of symptoms likely to be caused by the chemical, and a plurality of symptoms unlikely to occur. In the question generating step (S50), a question asking whether a specific symptom exists may be generated. The symptom to be confirmed is the number and possibility of occurrence of a specific symptom among chemicals that are search results, excluding symptoms recognized as having already appeared to the user 10 or symptoms recognized as not appearing. The symptoms with the smallest difference in the number of chemicals that do not have this effect can be selected. For example, there are 8 chemicals that can cause symptom A, 2 chemicals that cannot cause symptom A, 6 chemicals that can cause symptom B, and 2 chemicals that cannot cause symptom B. If there are 4 substances, choose Symptom B.

According to one embodiment of the present invention described above, in performing the symptom recognition step (S20) by the symptom recognition unit 210, the user 10 determines whether symptoms related to a specific item exist by analyzing body information and environment information. A symptom may be determined by asking a question and analyzing an answer of the user 10 . In addition, chemical substances are searched based on the symptoms input by the user 10, and when the number of chemical substances retrieved is large, the user 10 is asked whether there are symptoms related to the chemical substances, and the user 10 answers The number of chemicals can be reduced by analysis. In this way, check the symptoms

Although the present invention has been described in detail through specific examples, this is for explaining the present invention in detail, the present invention is not limited thereto, and within the technical spirit of the present invention, by those skilled in the art It will be clear that the modification or improvement is possible.

All simple modifications or changes of the present invention fall within the scope of the present invention, and the specific protection scope of the present invention will be clarified by the appended claims.

10: User
20: network
30: Response Agency
40: environment
100: terminal
100A: wearable terminal
100A1: helmet terminal
100A2: vest terminal
100A3: smart watch terminal
100B: non-wearable terminal
100B1: fixed terminal
100B2: mobile terminal
110: voice input unit
120: audio output unit
130: control unit
140: environmental sensor unit
150: body sensor unit
160: terminal communication unit
170: terminal storage unit
200: server
210: symptom recognition unit
220: question generator
230: material estimation unit
240: notification providing unit
250: symptom database
260: server communication unit
270: server storage unit

Claims (14)

An information collection step of providing a voice conversation generated by voice conversation between the terminal and the user, body information generated by the terminal sensing the user's body, and environment information generated by sensing the environment in which the user is located to the server;
a symptom recognition step in which the server recognizes a symptom displayed on the user's body based on the voice conversation body information and environment information;
a chemical substance estimating step of estimating, by the server, a chemical substance exposed to the user's body based on the recognized symptoms; and
When the symptom is not determined in the symptom recognition step or the chemical substance is not determined in the chemical substance estimation step, a question generating step of generating a question to be output to the user, recognizing the symptom of the body and chemical substance How to estimate . The method of claim 1,
The information gathering step
a voice communication step of receiving symptoms appearing on the user's body through voice communication between the terminal and the user;
a body sensing step in which the terminal worn on the user's body senses the user's body to generate body information and provide it to a server; and
An environment sensing step in which a terminal worn on the user's body or a terminal disposed in the space where the user is located senses the environment where the user is located to generate environment information and provide it to a server, recognizing symptoms of the body and chemical substances How to estimate . The method of claim 2,
The voice conversation step is
It can be performed through questions and answers between the terminal and the user, and a voice conversation is started while speaking the symptoms of the body perceived by the user to the terminal by voice, or body information or environmental information sensed by the terminal is sent to the server. A method of recognizing symptoms of the body and estimating chemical substances, which is started by analyzing and asking a user a question by voice through the terminal. The method of claim 1,
The symptom recognition stage is
a first range determination step in which the server compares items and values included in the body information and environment information with reference ranges according to the items, and determines whether or not they are out of the standard range;
a trend generation step in which the server creates a trend with values collected in chronological order for each item included in the body information and environment information; and
A second range determination step of comparing an expected range obtained using the trend with items and values included in the body information and environment information, and determining whether it is out of the expected range;
The question creation step is
If it is determined to be out of the range in the first range determination step or the second range determination step, generating a first type of question asking whether there is a symptom related to an item out of range, How to recognize and estimate chemicals. The method of claim 1,
The symptom recognition stage is
a voice recognition step of generating a text sentence by recognizing a voice included in the voice conversation by a server;
a first symptom determination step of analyzing the text sentence to determine whether a symptom that can be expressed in language exists in the body of the user;
a second symptom determination step of analyzing the voice conversation and the text sentence to recognize a non-verbal expression and determining whether a symptom exists in the user's body; and
In the first symptom determination step or the second symptom determination step, when the symptom is recognized or recognized as no symptom, a symptom determination step of determining whether the symptom exists or not, recognizing the symptoms of the body and estimating the chemical method. The method of claim 4,
The symptom recognition stage is
an item determination step of determining whether an item out of the range is included in an urgent item before performing the question generation step when it is determined that the item is out of the range in the first range determination step or the second range determination step; and
In the item determination step, when an item outside the range is included in an emergency item, a symptom confirmation step of determining that a symptom related to the emergency item exists, a method for recognizing symptoms in the body and estimating chemical substances . The method of claim 1,
The question creation step is
generating a first type of question inquiring whether a symptom related to an item out of the range exists when it is determined that a value of an item included in the body information and environment information is out of a predetermined range; and
In relation to the chemical substance estimated using the symptom database in the chemical substance estimation step, generating a second type of question for confirming whether a symptom that is not expected to appear or a symptom that is expected to appear exists , a way to recognize symptoms in the body and estimate chemicals. The chemical estimation step is
A symptom-based estimating step of searching for a chemical substance causing a symptom appearing in the user's body by using a symptom database including a chemical substance and a knowledge graph generated by learning symptoms appearing when the chemical substance is exposed to the body; and
Recognizing the symptoms of the body and including a determination step of determining one or more chemical substances with a high probability as the final exposure chemical substance when the substance estimated to be the chemical substance causing the symptom on the user's body is smaller than the reference number How to estimate . a voice input unit that receives information spoken by a user through voice;
a voice output unit outputting a question to the user by voice; and
A control unit controlling the voice input unit and the audio output unit to perform questions and answers with the user by voice and provide the information to the server;
The above question
First, when the server analyzes the user's body information or environment information and determines that the value of an item included in the body information and environment information is out of a predetermined range, whether there is a symptom related to the item out of the range. type of question; and
In relation to the chemical substance estimated using the symptom database in the server, a second type of question confirming whether there is a symptom that is not expected to appear or a symptom that is expected to appear,
The above answer is
A terminal that performs a method of recognizing a symptom of a body and estimating a chemical substance, including information for confirming whether a symptom exists in the body of the user, as an answer to the question or as a judgment of the user. a body sensor unit that senses the user's body and generates body information;
an environment sensor unit configured to sense an environment in which the user is located and generate environment information; and
And a control unit that collects the body information and environment information and provides them to a server,
The control unit
The body information and environmental information are measured at predetermined cycles, and while the question and answer are in progress, the body sensor unit and the environment sensor unit are controlled to measure at shorter intervals than the predetermined period, recognizing symptoms of the body and detecting chemicals. A terminal that performs an estimation method. According to claim 9 or claim 10,
The terminal
A terminal that performs a method of recognizing a symptom of a body and estimating a chemical substance, implemented as a device worn on the body, implemented as a robot that moves in a predetermined area, or implemented as a facility disposed in a predetermined space. a symptom recognition unit for recognizing a symptom by analyzing body information of a user received from a terminal, environmental information of an environment in which the user is located, and voice conversation between the user and the terminal;
a symptom database including a chemical substance and a knowledge graph generated by learning symptoms that appear when the chemical substance is exposed to the body;
Chemicals that cause symptoms recognized by the symptom recognition unit are estimated by searching the symptom database, and if the number of estimated chemicals is smaller than the reference number, substance estimation that determines the finally exposed chemicals in order of high probability. government; and
When the symptom recognizing unit fails to determine a symptom or the substance estimating unit fails to determine a chemical substance, including a question generating unit generating a question to be output to the user, recognizing a symptom of the body and estimating a chemical substance How to do server. The method of claim 12,
The symptom recognition unit
Items and values included in the body information and environmental information are compared with the predicted range predicted using the standard range or trend, and if it is determined to be outside the range, the question generation unit requests a question to be generated, and the voice conversation is converted into text. A server that performs a method of recognizing a symptom in the body and estimating a chemical substance by recognizing a sentence and determining whether a symptom that can be expressed in a language or a symptom recognizable as a non-verbal expression exists. The method of claim 12,
The question generator
A first type of question inquiring whether there is a symptom related to an item out of the range when it is determined that the value of an item included in the body information and the environment information is out of a predetermined range by analyzing the body information or the environment information; and
Regarding the chemical substance estimated using the symptom database, recognizing a symptom in the body, which generates either a second type of question confirming whether a symptom that is not expected to appear or a symptom that is expected to appear is present A server that performs methods for estimating chemicals.

Images