JP2022510350A - Interactive health assessment method and its system - Google Patents

Abstract

The interactive health assessment system provides an interactive database containing multiple health assessment questions presented by the data output interface, a multimodal data entry interface configured to receive response information, and the type of response information. An identification module configured to determine, a semantic interpretation module configured to extract keywords from text-type response information, and a first evaluation result generated according to the numeric-type response information to be used as keywords. Selectively, the health condition evaluation module is configured to generate a second evaluation result according to the evaluation result and generate and output the evaluation report according to the evaluation result, and the health condition evaluation module is configured to output the evaluation report. Includes a control module configured to notify or select another health assessment question from the follow-up items for the selected health assessment question. [Selection diagram] FIG. 1A

Description

The present disclosure relates to health assessment, and more particularly to interactive health assessment systems and methods thereof.

With the advent of an aging society, long-term care for the elderly has become one of the most worrisome issues in modern society and at home. On the other hand, with the rapid development of the interaction between robots and artificial intelligence, the home care services that can be provided are becoming more diverse. For example, a robot having a healthcare function or a companion function can support the care of the elderly at home or the elderly living alone. By technicalizing long-term care work, it is possible to reduce the burden of a shortage of caregivers. In the medical setting, robots support repetitive health education for health care workers, allowing them to focus on the individual care they need and improve the quality of their care.

However, existing systems that combine artificial intelligence technology and healthcare do not have an interactive mechanism with the subject being cared for. We communicate using language, which is a type of unstructured data. If the software in the above system lacks a deep semantic design, the only help in making a decision is to rely on similar things and the experience of similar users. Therefore, the system is usually unable to provide smarter health assessments based on current user preferences, causality, and context, and accurately the user's intent when interacting with the user. It is often difficult to detect.

From this point of view, the present disclosure proposes an interactive health condition evaluation system and an interactive health condition evaluation method for solving the above problems.

The interactive health condition evaluation method according to the embodiment of the present disclosure is to select a health condition evaluation question from the dialogue design database and present the health condition evaluation question by a data output interface. Each of the health assessment questions, including multiple health assessment questions, has a follow-up item corresponding to zero or at least one other health assessment question in the interactive design database. The multimodal data entry interface receives reply information. The identification procedure determines the type of the reply message, and if the reply information belongs to a numerical type, the health condition evaluation program generates a first evaluation result and temporarily sets the first evaluation result according to the reply information and the numerical rule. When the reply information belongs to the text type, the meaning understanding program extracts the keyword from the reply information, and the health condition evaluation program generates the second evaluation result according to the keyword, and the second evaluation result is generated. The evaluation result of 2 is stored in a temporary storage area. After the first evaluation result or the second evaluation result is generated, it is determined whether or not the dialogue end signal is received, and if the dialogue end signal is received, the health condition evaluation program is temporary. Outputs an evaluation report according to the data in the storage area, and if the dialogue end signal is not received, select another health evaluation question in the follow-up item.

The interactive health condition assessment system according to an embodiment of the present disclosure is an interactive design database containing a plurality of health condition evaluation questions, each of which is zero or at least one in the interactive design database. An interactive design database that has follow-up items for two other health assessment questions, a data output interface for health assessment that is communicably connected to the interactive design database, and receiving reply information. An identification module connected to a multimodal data input interface and an identification module for determining whether the reply information belongs to a text type or a numeric type, and an identification module. Communicatably connected to a semantic interpretation module that classifies the type of information using keywords, and communicable to an identification module and a semantic interpretation module, according to the numerical rules belonging to the reply information belonging to the numeric type and the numeric type reply. The evaluation result of 1 is generated, the second evaluation result is generated according to the keyword, the first and second evaluation results are stored in the temporary storage area, and the second evaluation result is stored in the temporary storage area. A health condition evaluation module that outputs an evaluation report based on data is communicably connected to an interactive design database, a multimodal data input interface, and a health condition evaluation module, and a health condition evaluation report is output when a dialogue end signal is received. Includes a control module configured to output. If the dialogue end signal is not received, another health condition evaluation question is selected from the follow-up items of the health condition evaluation question.

With the above techniques, the interactive health condition assessment system and methods thereof disclosed by the present disclosure can interpret semantic meanings and better understand the user's intentions and needs through dialogue with the user.

It is a schematic block diagram of the interactive health condition evaluation system by one Embodiment of this disclosure. FIG. 3 is a schematic block diagram of an interactive health condition assessment system according to another embodiment of the present disclosure. It is a flowchart of the interactive health condition evaluation method by one Embodiment of this disclosure.

The above description of the present disclosure and the following embodiments are intended to illustrate the spirit and principles of the invention and provide further description of the scope of the invention.

The detailed features and advantages of the present disclosure are described in detail below in embodiments of the present disclosure. The features and advantages associated with this disclosure can be readily appreciated by those of skill in the art. The following examples are intended to explain the present disclosure in more detail, but are not intended to limit the scope of the invention in any way.

The interactive health assessment system and methods disclosed in this disclosure, in addition to paying particular attention to the interaction between the system and the user, through the interactive questions and answers designed by this disclosure. , Further evaluate the user's health condition. In the following, an embodiment of the hardware architecture of the interactive health condition assessment system of the present disclosure will be described together with the functions of the components in the system. This disclosure further introduces another hardware architecture embodiment and its applications, and finally introduces an interactive implementation based on health assessment methods.

Interactive health status according to one embodiment of the present disclosure, including interactive design database 102, identification module 104, semantic interpretation module 106, health status assessment module 108, data output interface 202, multimodal data input interface 204, and control module 206. See FIG. 1A, which shows the evaluation system. Specifically, the interactive design database 102 may be implemented by a storage device, and the identification module 104, the semantic interpretation module 106, the health condition evaluation module 108, and the control module 206 may be implemented by individual arithmetic units. It may be integrated into a single computing device.

The dialogue design database 102 stores a plurality of health condition evaluation questions in a data sheet format. Each health assessment question has a follow-up item. Follow-up items correspond to zero or at least one other health assessment question in the interactive design database 102. In one embodiment, each health assessment question has a set of response keywords corresponding to follow-up items. In another embodiment, each health assessment question has a trigger keyword set.

See Table 1 below, which is an example of a data sheet for the interactive design database 102. In one embodiment, all health status assessment questions in the dialogue design database 102 correspond to various contents such as sleep, blood glucose level, blood pressure, end of answer, and the like. In the data sheet, each health assessment question corresponds to a number and question script. The use of the remaining fields in the datasheet will be described later in relation to the functionality of other modules.

Table 1: An example of the data sheet of the dialogue design database 102

Please continue to refer to FIG. 1A. The data output interface 202 electrically connects and communicates with the interactive design database 102, and the data output interface 202 is used to present selected health assessment questions to the user in a visual or audible manner. Will be done. In reality, the data output interface 202, such as a screen or speaker, displays text, images, animated characters, and plays selected health assessment questions by voice. The present disclosure shows, but is not limited to, the hardware type of the data output interface 202 and the medium of the output question.

After the user obtains the health condition evaluation question from the data output interface 202, the multimodal data input interface 204 of the interactive health condition evaluation system according to the present embodiment of the present disclosure receives the response information from the user. In practice, the multimodal data input interface 204 can employ hardware devices such as microphones, cameras, touch panels, physiological information measuring instruments (such as blood glucose meters) and computer peripherals, and the multimodal data input interface 204. The input mode to is, for example, voice input, image input, click screen input, bluetooth transmission or wireless transmission, and the data format of the reply information can include voice, image, trigger signal, text and / or number. ..

Please continue to refer to FIG. 1A. The identification module 104 is communicably connected to the multimodal data input interface 204, and the identification module 104 is configured to perform identification procedures such as software or code running on the processor. The identification procedure is used to determine whether the reply information belongs to a text type or a numeric type. For example, an audio signal received by a microphone (multimodal data input interface 204) is converted into text, or an electronic signal measured by a glucose meter is converted into a numerical value. Specifically, the numerical type data includes, for example, vital signs such as body temperature, blood pressure, heart rate, and respiratory rate, or physiological data such as blood glucose level and blood lipids.

Please continue to refer to FIG. 1A. The semantic interpretation module 106 is electrically connected to the identification module 104 and communicates with the identification module 104. The semantic interpretation module 106 is used to execute a semantic interpretation program such as software or program code that is executed on a processor or a database having a plurality of keywords. Semantic interpretation programs are used to search for one or more keywords from response information belonging to a text type. Grammar analysis and semantic analysis are realized by neural networks and machine learning. In other words, the semantic interpretation program translates the text into the language framework of the idea, from which the user's intent and the keywords answered by the user are extracted. For example, understand that current users are talking about sleep disorders and blood sugar issues.

Please continue to refer to FIG. 1A. The health condition assessment module 108 electrically connects and communicates with the identification module 104 and the semantic interpretation module 106 to execute a health condition assessment program such as software or program code executed on the processor. The health condition assessment program is used to generate a first assessment result from the response information and the numerical rules corresponding to the numerical status. For example, the value measured by the blood glucose meter is compared with the blood glucose level (numerical rule) in the normal range stored in advance, and the first evaluation result is generated. Further, when the semantic interpretation module 106 searches for a keyword, the health condition evaluation module 108 is to generate a second evaluation result based on the keyword and the health condition evaluation question selected from the dialogue design database 102. Also works.

When the multimodal data input interface 204 acquires the information input from the user, the health condition evaluation module 108 generates at least one of the first evaluation result and the second evaluation result, and the generated evaluation result is one. Store in temporary storage area. The reply from the user may be text data only, numerical data only, or may include both. For example, a user tells the system, "I couldn't sleep well last night and I should have a fever of 38 degrees or higher." In this example, the health condition evaluation module 108 generates a second evaluation result based on keywords such as "sleep" and "bad", and generates a first evaluation result based on the numerical data "38 degrees". do. When the interactive health condition evaluation system according to the embodiment of the present disclosure detects that the user has completed the health condition evaluation process, or detects that the user has interrupted the health condition evaluation process, the health condition evaluation module. 108 outputs an evaluation report based on the data stored in the temporary storage area. In another embodiment of the disclosure, the interactive health assessment system may further include a user database for storing historical assessment reports for each user. Therefore, each time the user generates a new assessment report through the system, the health assessment module 108 can further incorporate historical data into this new assessment report, thereby more accurately reflecting the user's health status. be able to.

Please continue to refer to FIG. 1A. The control module 206 communicatively connects the interactive design database 102, the multimodal data input interface 204, and the health condition assessment module 108, thereby performing an interactive health condition assessment process in cooperation with the above components. .. In practice, the control module 206 is, for example, software or program code running on the processor. When the control module 206 receives the dialogue completion signal, it notifies the health condition evaluation module 108 to output an evaluation report, and when it does not receive the dialogue completion signal, the control module 206 starts from the follow-up item of the health condition evaluation question. Select another health assessment question. The dialogue completion signal can be generated by the multimodal data input interface 204, such as by pressing toward the back button on the touch panel or by saying "end dialogue" to the microphone, or, for example, the user can set a certain dialogue level. To achieve this, it is generated after the system detects the following conditions in which a certain number of answers to the health condition assessment questions in the dialogue design database 102 are answered.

The situation where the control module 206 selects another health assessment question is described below. In another embodiment of the present disclosure, the control module 206 determines whether a keyword fits a response keyword set and, if the keyword fits a response keyword set, a follow-up corresponding to the response keyword set. Select an item and do more. See Table 1. For example, if the currently selected question is Q3 "Did you drink something containing caffeine before going to bed last night?", The response key for Q3 contains "yes" and "no". When the control module 206 confirms that the keyword extracted by the semantic interpretation module 106 contains "yes" according to the follow-up item field of Q3 in Table 1, the Q7 asks the user to answer the following: Selected as a health assessment question. If the follow-up item has multiple question numbers, one of them will be randomly selected as the next health assessment question, or the question will be queued and the user will be queried in sequence.

In another embodiment of the present disclosure, the control module 206 further performs searching for another health assessment question from the same trigger keyword set as this health assessment question. For example, if the question this time is Q3, the user does not ask the question directly, but states that he "sweat cold" last night. When the control module 206 confirms that the keywords extracted by the semantic interpretation module 106 include "cold sweat", it searches all the "trigger keyword sets" in Table 1, finds Q7, and then performs health. Select Q7 as the status evaluation question. In fact, if the user's reply signal contains both a "trigger keyword set" and a "response keyword set", the next health assessment question to be selected is determined according to the priority of the two. You can also choose one of them at random and use it as your first question. The present disclosure is not limited to this.

In fact, in the dialogue design database 102, the next question number set in the follow-up item is mostly set to another question in the same purpose category. As such, the system can ask more comprehensive questions about the same objective category in order to gain a deeper understanding of the user's situation. In yet another embodiment of the present disclosure, the control module 206 further calculates user completion for each objective category. The "user perfection" is, for example, a percentage obtained by dividing the number of questions answered by the user by the total number of questions in the category. Therefore, when the system selects the next health assessment question, if the follow-up item contains multiple question number candidates, the system first pre-populates the user completeness of the target category to which the question belongs. Determine if the set threshold has been reached. Otherwise, the system will select another question from the follow-up items that belongs to the same purpose category as the current question until the number of questions reaches a preset threshold for the degree of completion of the target category, after which the system will select it. , The user selects another question for another purpose to continue answering. Even if the user first jumps to another target category with the "trigger keyword set", the system will return to the previous target category and continue asking questions after the destination target category is complete.

If the follow-up item selected in the interactive design database 102 is empty (eg Q99) in response to the current health assessment question, the system ends processing of the interactive question and answer. In the above case, for example, after the user has completed a certain number of interactive questions and answers, the system can determine that sufficient information has been collected and generate an evaluation report for the user to confirm, interacting. End the type question and answer process. As another example, the interactive question and answer process can be stopped when the user wants to end the dialogue. In the question and answer process, control module 206 provides Q99 in the dialogue design database 102 to see if the user provides other comments. If the user chooses No, the interactive question and answer process ends.

According to the mechanism described above for selecting the next health assessment question, the interactive health assessment system described in one embodiment of the present disclosure provides a better understanding of the user's semantics and the user's intent and. Get to know your needs better. At the same time, a more accurate evaluation of the health condition is performed according to the response information provided by the user.

See FIG. 1B, which is a block diagram of an interactive health condition assessment system according to another embodiment of the present disclosure, comprising, for example, an evaluation device 10 and a dialogue device 20 communicatively connected to each other by a wired or wireless network connection NC. sea bream. However, this disclosure is not limited to this.

The evaluation device 10 of the present embodiment is, for example, a cloud platform, and includes an interactive design database 102, an identification module 104, a semantic interpretation module 106, a health condition evaluation module 108, and a communication module 109, and includes components 102 to 102. The functions and configurations of 108 are as exemplified above and will not be described again.

Specifically, the communication module 109 is electrically connected to the dialogue design database 102 and the health condition evaluation module 108. The communication module 109 sends the selected health assessment question and assessment report to the dialogue device 20 via the network connection NC in a data format (eg, for example) for the selected health assessment question and assessment report. Convert to network packet).

Further, the evaluation device 10 may further include a living resource, a learning resource, a content resource, or a database such as a language database and a user database. In the interactive health condition assessment system according to one embodiment of the present disclosure, the user database is communicably connected to the health condition evaluation module 108 and identifies the corresponding user according to the user's facial image or the user's voice. The evaluation report is also stored in this user database.

The dialogue device 20 is, for example, a mobile body (for example, a robot) capable of being equipped with an image pickup device, or a mobile device (for example, a smartphone or tablet) on which the image pickup device can be mounted. It is a form of an application (APP) installed in the dialogue device 20. The dialogue device 20 includes a data output interface 202, a multimodal data input interface 204, a control module 206, a detection device 208, and a communication module 209. The functions and configurations of the components 202 to 206 are referred to in the previous section, and the details are not repeated here. The communication module 209 is communicably connected to the data output interface 202, the multimodal data input interface 204 and the control module 206, and the control module 206 is communicably connected to the detection device 208 in this embodiment.

The detection device 208 is, for example, an image pickup device or a microphone for obtaining image data or audio data, and the obtained data is transmitted to the control module 206 to determine whether or not there is a detected user. Specifically, when the image data includes the user's face image or the voice data includes the user's voice, the control module 206 interacts through the network connection NC via the communication module 109. Select one health assessment question from the design database 102.

Based on the above two embodiments, it can be seen that while integrating all the components of the interactive health assessment system into one hardware device, the three embodiments described below are also included.

Embodiment 1: This system is mounted on a moving body provided with an image pickup device, and detects whether or not a user is around by a dialogue or a command via the image pickup device, sends a greeting to the user, or is a system. You can activate the function. When the user operates a system function, the system uploads the operation history to the cloud database and updates the function of the component related to the system. Finally, the system exports charts and reports to the user, providing the user with further learning and reference.

Embodiment 2: The system is mounted on a mobile body, and the system can actively interact and interact with the user. Through the process of dialogue and building a knowledge base, the system can understand the concepts that the user lacks and provide a learning list that corresponds to the user.

Embodiment 3: This system is installed in a mobile device, and the system can actively interact and interact with users. By establishing a database of relevant information such as dialogue processes, times, situations, and lifestyles, the system can recommend personalized lists to users for convenience.

Please refer to FIG. 2, which is a flowchart of the execution of the interactive health condition evaluation method according to the embodiment of the present disclosure.

Step S10: Refer to the determination of whether or not the user has been detected. Specifically, the detection device 208 acquires image data or audio data, and the control module 206 determines whether the image data includes the user's face image or the user's audio data. If the image data contains the user's face image, or if the voice data contains the user's voice data, the process proceeds to step S12, and if not, the detection device 208 continues the detection process. .. The system can also detect the user via the detection device 208 and send a greeting. The user can also send commands directly to the system via the multimodal data input interface 204 to boot the system and engage in dialogue.

See Step S12: Selection and presentation of health assessment questions. Specifically, the system selects a health assessment question from the dialogue database 102 and presents the health assessment question through the data output interface 202.

Step S14: Refer to the reception of the response information. Specifically, the system receives the response information of the user's voice, image, or physiological measurement signal via the multimodal data input interface 204. For example, audio data is received by the sensing module, trigger signals are received by the touch screen, and Bluetooth input signals and wireless input signals are received by the communication module.

Step 20: Refer to the determination of the response information type. Specifically, the identification module 104 determines whether the response information belongs to a numeric type or a text type. If the response information belongs to a numerical type, with reference to step S22, the health condition assessment module 108 generates a first assessment result according to the response information and a preset numerical rule. On the other hand, when the response information belongs to the text type, the semantic interpretation module 106 searches for a keyword from the response information with reference to steps S24 to S26, and then the health condition evaluation module 108 is the first based on the keyword. Generate the evaluation result of 2. The health condition evaluation module 108 further stores at least one of the above two evaluation results in a temporary storage area.

Step S30: Refer to the determination of whether or not the dialogue end signal has been received. Specifically, if the dialogue end signal has not been received, another health assessment question is selected from the follow-up items of the health assessment question, and the process returns to step S12. To determine if an end-of-dialogue signal has been received, receive a trigger signal to indicate the end of the dialogue, or receive a follow-up item for the health assessment question that corresponds to the zero health assessment question. There are methods and so on.

Conversely, if the system is receiving an end-of-dialogue signal, the health assessment module 108 outputs an assessment report based on the data in the temporary storage area, as shown in step S32, and provides the data output interface 202. Present the evaluation report through. Further, before outputting the evaluation report, the storage area of the corresponding user is searched according to the user's face image or the user's voice, and the evaluation report is stored in the storage area corresponding to the current user. Including further.

In summary, the interactive health assessment system and methods described in this disclosure have been introduced into home robots and APPs and applied to homes to meet companion demands to ease the burden of an aging society and long-term care. can do. It can also be applied in the field of medical care, replacing the repetitive health education of medical staff so that medical staff can focus on individual patient care and improve and optimize the quality of medical care. can.

Although the present disclosure has been disclosed in the above-described embodiment as described above, it is not intended to limit the present invention. Within the scope of the present invention, changes can be made without departing from the gist of the present invention. See the attached patent application for the scope of rights defined by this disclosure.

See Table 1 below, which is an example of a data sheet for the interactive design database 102. In one embodiment, all health assessment questions in the dialogue design database 102 correspond to various purposes such as sleep, blood glucose, blood pressure, end of answer, and the like. In the data sheet, each health assessment question corresponds to a number and question script. The use of the remaining fields in the datasheet will be described later in relation to the functionality of other modules.

Table 1: An example of the data sheet of the dialogue design database 102

Please continue to refer to FIG. 1A. The data output interface 202 electrically connects and communicates with the interactive design database 102, and the data output interface 202 is used to present selected health assessment questions to the user in a visual or audible manner. Will be done. In reality, the data output interface 202, such as a screen or speaker, displays the selected health assessment question in text, image, animation, or plays it back by voice . The present disclosure shows, but is not limited to, the hardware type of the data output interface 202 and the medium of the output question.

The method by which the control module 206 selects another health assessment question is described below. In another embodiment of the present disclosure, the control module 206 determines whether a keyword fits a response keyword set and, if the keyword fits a response keyword set, a follow-up corresponding to the response keyword set. Select an item and do more. See Table 1. For example, if the currently selected question is Q3 "Did you drink something containing caffeine before going to bed last night?", The response key for Q3 contains "yes" and "no". When the control module 206 confirms that the keyword extracted by the semantic interpretation module 106 contains "yes" according to the follow-up item field of Q3 in Table 1, the Q7 asks the user to answer the following: Selected as a health assessment question. If the follow-up item has multiple question numbers, one of them will be randomly selected as the next health assessment question, or the question will be queued and the user will be queried in sequence.

In another embodiment of the present disclosure, the control module 206 further performs searching for another health assessment question for which the trigger keyword set matches the keyword . For example, if the question this time is Q3, the user does not ask the question directly, but states that he "sweat cold" last night. When the control module 206 confirms that the keywords extracted by the semantic interpretation module 106 include "cold sweat", it searches all the "trigger keyword sets" in Table 1, finds Q7, and then performs health. Select Q7 as the status evaluation question. In fact, if the user's reply signal contains both a "trigger keyword set" and a "response keyword set", the next health assessment question to be selected is determined according to the priority of the two. You can also choose one of them at random and use it as your first question. The present disclosure is not limited to this.

Based on the above two embodiments, it can be seen that in addition to integrating all the components of the interactive health assessment system into one hardware device, the three embodiments described below are also included.

Claims (11)

Select a health assessment question from the dialogue design database and present the health assessment question through the data output interface.
Receiving a reply message through the multimodal data entry interface after the health assessment question has been presented by the data output interface.
Determining the type of the reply message by the identification procedure,
When the reply message is a numerical type, the health condition evaluation procedure generates a first evaluation result according to the reply message and the numerical rule, and stores the first evaluation result in a temporary storage area.
When the reply message is a text type, a keyword is extracted from the reply message by a semantic interpretation procedure, a second evaluation result corresponding to the reply message is generated by the health condition evaluation procedure, and the second evaluation result is generated. To store in the temporary storage area,
Determining whether or not a dialogue end signal has been received after generating the first evaluation result or the second evaluation result.
If the dialogue end signal is received, the health condition evaluation procedure outputs an evaluation report according to the data in the temporary storage area, and if the dialogue end signal is not received, another health. Including selecting a condition assessment question,
The interactive design database contains a plurality of health assessment questions, each of which is a follow-up item corresponding to zero or at least one other health assessment question in the interactive design database. Have and
The other health condition assessment question is an interactive health condition assessment method that is selectively selected from the follow-up items. Each of the health assessment questions has a response keyword set corresponding to the follow-up item.
The first aspect of claim 1, wherein selecting the other health assessment question further comprises selecting the follow-up item corresponding to the response keyword set if the keyword satisfies the response keyword set. Interactive health assessment method. Each of the health assessment questions has a trigger keyword set and
The selection of the other health assessment question further comprises finding the corresponding from the trigger keyword set of the health assessment question as the other health assessment question, claim 1. Interactive health assessment method described in. Before selecting the health assessment question from the dialogue design database,
Acquiring image data or audio data by a detection device,
Determining whether the image data has a user's face image or the voice data has a user's voice signal.
Further comprising initiating selection of the health condition assessment question from the dialogue design database when the image data contains the user's facial image or the voice data contains the user's voice signal. , The interactive health condition evaluation method according to claim 1. Determining whether or not the dialogue end signal has been received is to receive a trigger signal indicating the end of the dialogue, or to receive a follow-up item of the health assessment question corresponding to the zero health assessment question. The interactive health condition evaluation method according to claim 1, comprising the above. Before outputting the evaluation report,
Searching the user database for a storage area corresponding to the user according to the user's face image or the user's voice signal.
The interactive health condition assessment method of claim 4, further comprising storing the assessment report in the storage area. An interactive design database containing multiple health assessment questions, each of which is a follow-up corresponding to zero or at least one other health assessment question in the interactive design database question. Dialogue design database with items and
With a data output interface, which is communicably connected to the interactive design database and configured to present the health assessment question.
With a multimodal data entry interface configured to receive reply messages,
An identification module connected to the multimodal data input interface and configured to determine whether the reply message belongs to a text type or a numeric type.
A semantic interpretation module communicatively connected to the identification module and configured to extract keywords from reply messages belonging to the text type.
Communicatably connected to the identification module and the semantic interpretation module, it generates a first evaluation result according to the reply message and the numerical rule belonging to the numerical type, and generates a second evaluation result according to the keyword. A health condition evaluation module configured to store the first and second evaluation results in a temporary storage area and output an evaluation report based on the data stored in the temporary storage area.
Communicatably connected to the dialogue design database, the multimodal data input interface, and the health condition assessment module, and notifying the health condition assessment module to output the assessment report when a dialogue end signal is received. A control module configured to select another health assessment question if the end-of-dialogue signal has not been received.
An interactive health assessment system, wherein the other health assessment questions are selectively selected from the follow-up items. Each of the health condition assessment questions has a response key corresponding to the follow-up item, the control module determines whether the keyword sink matches the response keyword set sink, and the keyword is The interactive health condition assessment system of claim 7, further configured to select a follow-up item corresponding to the response keyword set sink if the response keyword set sink is matched. Each of the health assessment questions further comprises a trigger keyword set, the control module using the trigger keyword set in the health assessment question to the keywords as other health assessment questions. The interactive health condition assessment system according to claim 7, further configured to search for matching persons. Further comprising a detection device communicatively connected to the control module and configured to acquire image or audio data.
The control module is further connected to the data output interface and further configured to determine if the image data has a user's facial image or if the audio data has the user's audio. If the data has the user's facial image or the voice data has the user's voice, the control module selects the health condition assessment question from the dialogue design database and uses the data output interface. The interactive health condition evaluation system according to claim 7, wherein the problem of the health condition evaluation is presented. Further including a user database connected to the health condition evaluation module, the health condition evaluation module searches for a storage area corresponding to the user based on the user's face image or the user's voice, and the evaluation report. The interactive health condition evaluation system according to claim 8, wherein the storage area is stored in the storage area.

Images