TW202022891A - System and method of interactive health assessment - Google Patents

Abstract

A system of interactive health assessment system comprises a dialogue design database having a plurality of health assessment questions presented by a data output interface; a multi-modal data input interface is configured to receive an reply message; a recognition module is configured to determine a type of the reply message; a semantic interpretation module is configured to extract a keyword from the text-type reply message; a health state assessment module is configured to generate a first assessment result according to the value-type reply message, a second assessment result according to the keyword and output an assessment report according to the assessment results; and a control module is configured to selectively notify the health assessment module to output the assessment report or select another health assessment question from a follow-up item of the selected health assessment question.

Description

Interactive health status assessment system and method

The present invention relates to health status assessment, in particular to an interactive health status assessment system and method.

With the advent of an aging society, the long-term care of silver-haired people has become one of the most concerned issues of modern society and families. On the other hand, with the rapid development of interaction between robots and artificial intelligence, the services that can be provided are becoming more and more diversified. For example, robots with home health care and companionship can assist children in taking care of the elders in the family or living alone. The scientific and technological way of care work can relieve the pressure of the long-term care population. In medical care settings, robots can assist medical staff in repetitive health education, allowing medical staff to focus more on the individual care needs of patients, so as to improve and optimize medical quality.

However, the existing systems that combine artificial intelligence and health care lack an interaction mechanism with the recipients of care. Since there is no clear word boundary in Chinese dialogue, if the software layer of the above system lacks the design of in-depth semantic understanding, it is often difficult to accurately detect the user's intention when talking to the user. It can only rely on similar items or similar users to assist in judgment, and fail to provide smarter health assessment results based on current user preferences, causality, and context.

In view of this, the present invention provides an interactive health assessment system and an interactive health assessment method to solve the above-mentioned problems.

The interactive health assessment method described in an embodiment of the present invention includes: selecting a health assessment question from a dialogue design database and presenting the health assessment question in a data output interface, wherein the dialogue design database includes a plurality of Health status assessment questions, each health status assessment question has a continuation item, and the continuation item corresponds to zero or at least another health status assessment question in the dialog design database; after the health status assessment question is displayed on the data output interface, The multi-modal data input interface receives the response information; the recognition process determines the type of the response information; when the response information is of a numeric type, the health status assessment process generates the first assessment result according to the response information and the numerical rules and saves the first assessment result in temporary storage Space; when the reply information is of text type, the semantic comprehension program extracts keywords from the reply information, and the health assessment program generates the second evaluation result based on the keywords and stores the second evaluation result in the temporary storage space; After the first evaluation result or the second evaluation result, determine whether the interaction end signal is received; when the interaction end signal has been received, the health status assessment program outputs the evaluation report based on the data in the temporary storage space; when the interaction end signal is not received , Choose another health status assessment question from the continuation items of the health status assessment question.

The interactive health assessment system described in an embodiment of the present invention includes: a dialogue design database, including a plurality of health assessment questions, each health assessment question has a continuation item, and the continuation item corresponds to the dialogue design data Zero or at least another health assessment question in the database; data output interface, communication connection dialog design database, data output interface for presenting health assessment questions; multi-modal data input interface for receiving response information; identification Module, the communication connection multi-modal data input interface, the identification module is used to determine whether the reply information belongs to the text type or the value type; the semantic understanding module, the communication connection identification module, the semantic understanding module is used for the reply belonging to the text type A keyword is extracted from the information; the health status evaluation module, the communication connection recognition module and the semantic understanding module, the health status evaluation module is used to generate the first evaluation result according to the response information of the numerical state and a numerical rule Keyword generates the second evaluation result, stores the first and second evaluation results in a temporary storage space, and outputs the evaluation report based on the data in the temporary storage space; and control module, communication connection dialog design database, multi-modal data input interface And health status evaluation module, the control module is used to notify the health status evaluation module to output the evaluation report when the interaction completion signal is received, and select another item from the health status evaluation problem when the interaction completion signal is not received. One problem of health assessment.

With the above-mentioned structure, the interactive health status assessment system and method disclosed in the present invention can understand the semantics of the user and better understand the user's intentions and needs through user dialogue.

The above description of the disclosure and the following description of the embodiments are used to demonstrate and explain the spirit and principle of the present invention, and provide a further explanation of the scope of the patent application of the present invention.

The following describes in detail the detailed features and advantages of the present invention in the embodiments. The content is sufficient for any person skilled in the relevant art to understand and implement the technical content of the present invention, and according to the contents disclosed in this specification, the scope of patent application and the drawings Anyone skilled in the relevant arts can easily understand the objects and advantages related to the present invention. The following examples further illustrate the viewpoints of the present invention in detail, but do not limit the scope of the present invention by any viewpoint.

The interactive health status evaluation system and method disclosed in the present invention not only pay special attention to the interaction between the system and the user, but also grasp the user's health status through the interactive question and answer designed in the present invention. The following first describes an embodiment of the hardware architecture of the interactive health assessment system of the present invention and the functions of the components in the system, and then introduces another embodiment of the hardware architecture and its application scenarios, and finally introduces the interactive implementation based on the system. Methods of health assessment.

Please refer to FIG. 1A, which illustrates an interactive health status assessment system of an embodiment of the present invention, including: dialogue design database 102, recognition module 104, semantic understanding module 106, health status assessment module 108, data output The interface 202, the multi-modal data input interface 204, and the control module 206. The hardware equipment used to implement the above components can be integrated in the same device, such as an interactive robot, which is not limited by the present invention

The dialog design database 102 stores a plurality of health assessment questions in the form of data tables. Each health status assessment question has a continuation item. The continuation item corresponds to zero or at least another health assessment question in the dialogue design database 102. In one embodiment, each health status assessment question has a response keyword vocabulary corresponding to the connection item. In another embodiment, each health status assessment question has a trigger keyword.

Please refer to Table 1 below, which is an example of a data table in the dialog design database 102. In one embodiment, all the health status assessment questions in the dialog design database 102 belong to multiple intents, such as sleep, blood sugar, blood pressure, end answer... and so on. In the data table, each health status assessment question corresponds to a number and a question script. The purpose of the remaining fields in the data table will be described later when describing the functions of other modules.

Table 1: Example of data table of dialog design database 102.

Please continue to refer to Figure 1A. The data output interface 202 is communicatively connected to the dialog design database 102, and the data output interface 202 is used to present the selected health status assessment questions for the user to watch or listen. In practice, the data output interface 202, such as a screen or a speaker, displays the selected health status assessment problem in the form of text, image, animation or voice. The present invention deals with the type of hardware of the data output interface 202 and the media for the output problem. The type is not limited.

After the user learns a health status assessment question from the data output interface 202, the interactive health status assessment system of an embodiment of the present invention provides a multi-modal data input interface 204 to receive response information from the user. In practice, the multi-modal data input interface 204 can use hardware devices such as microphones, camera devices, touch screens, physiological information measuring instruments (such as blood glucose meters) or computer peripheral devices; it is used to receive response information. The output methods are for example: voice input, image input, click screen input, Bluetooth transmission or wireless transmission; the data format of the reply information includes: sound, image, trigger signal, text or number, etc.

Please continue to refer to Figure 1A. The identification module 104 is communicatively connected to the multi-modal data input interface 204. The identification module 104 is used to execute an identification process, such as software or program code running on a processor. The recognition process is used to determine whether the reply information is of text type or numeric type. For example, the voice signal received by the microphone (multi-modal data input interface 204) is converted into text, or the electronic signal measured by the blood glucose meter is converted into a numerical value. Numerical data such as body temperature, blood pressure, heart rate, and breathing rate representing vital signs (Vital Signs). Or physiological data such as blood sugar, blood lipids, etc.

Please continue to refer to Figure 1A. The semantic understanding module 106 is in communication with the identification module 104. The semantic understanding module is used to execute a semantic understanding process, such as software or program code running on a processor or a software with multiple keywords. database. The semantic comprehension program is used to extract one or several keywords from the text-type reply information. Realize grammar and semantic analysis by way of neural network or machine learning.

Please continue to refer to Figure 1A. The health status evaluation module 108 is in communication with the identification module 104 and the semantic understanding module 106. The health status evaluation module is used to perform a health status evaluation process, such as software or software running on a processor. Code. The health status evaluation program is used to generate the first evaluation result according to the response information of the numerical status and a numerical rule. For example, the value measured by the blood glucose meter is compared with the pre-stored normal range blood glucose value (numerical rule) to generate the first evaluation result. In addition, when the semantic understanding module 106 extracts keywords, the health status evaluation module 108 is also used to generate a second evaluation result based on the keywords and the health status evaluation questions selected from the dialogue design database 102.

Every time the multi-modal data input interface 204 obtains information input by the user, the health assessment module 108 will generate at least one of the first assessment result and the second assessment result, and store the assessment result in a temporary storage. space. In other words, in addition to only textual data or numeric data, each user's reply may also include both. For example: the user told the system "I didn't sleep well last night, I should have a fever of over 38 degrees." In this example, the health status evaluation module 108 will generate the second evaluation result based on keywords such as "sleeping" and "bad", and generate the first evaluation result based on the numerical data of "38 degrees". When the interactive health status evaluation system of an embodiment of the present invention detects that the user has completed the health status evaluation process, or detects that the user has interrupted the health status evaluation process by itself, the health status evaluation module 108 will respond according to the temporary storage. Output evaluation report of data stored in space. In another embodiment of the present invention, the interactive health assessment system may further include a user database for storing historical assessment reports of each user. Therefore, whenever a user generates a new evaluation report through the system, the health status evaluation module 108 can also incorporate the previous historical data and calculate it together, thereby more accurately reflecting the user's health status.

Please continue to refer to Figure 1A. The control module 206 is communicatively connected to the dialog design database 102, the multi-modal data input interface 204, and the health evaluation module 108, thereby integrating the aforementioned components to perform an interactive health evaluation process. In practice, the control module 206 is, for example, software or program code running on a processor. When receiving the interaction completion signal, the control module 206 notifies the health status evaluation module 108 to output an evaluation report; when the interaction completion signal is not received, the control module 206 selects another health status from the continued items of the health status evaluation problem Condition assessment issues. The interaction completion signal is generated by the user through the multi-modal data input interface 204, such as pressing the return button on the touch screen or saying "end interaction" into the microphone; it can also be generated by the system detecting the following conditions: For example, the user has answered a certain number of health assessment questions in the dialogue design database 102 to reach a certain level of interaction.

The following describes how the control module 206 selects another way of evaluating the health status. In another embodiment of the present invention, the control module 206 further includes: determining whether the keyword matches the response keyword vocabulary, and selecting the continuation item corresponding to the response keyword vocabulary when the keyword matches the response keyword vocabulary. Please review Table 1. For example, when the currently selected question is Q3: "Did you drink caffeinated beverages before going to bed last night?", the answer key words corresponding to Q3 include "Yes" and " No. Therefore, when the control module 206 confirms that the keyword extracted by the semantic understanding module 106 contains "Yes" or "Yes", it selects Q7 as the next question according to the continuation item field of Q3 in Table 1. The user’s health status assessment question. When there are multiple question numbers in the continuation item field, one of them is randomly selected as the next health status assessment question, or these questions are queued to ask the user sequentially.

In another embodiment of the present invention, the control module 206 further includes: searching for a keyword matching the keyword from the triggering keyword in the health status assessment question as another health status assessment question. For example: when the currently selected question is Q3, the user did not directly answer the question, but stated that he was "sweating cold" last night. When the control module 206 confirms that the keyword extracted by the semantic understanding module 106 contains "cold sweat", it retrieves all the "trigger keywords" in Table 1 and finds Q7, so select Q7 as the next user to be asked Health status assessment problem. In practice, when the user's response signal contains both "trigger keyword vocabulary" and "response keyword", the next health assessment question to be selected can be determined according to the priority of the two, or one of them can be randomly selected The person asks the user first, and the present invention does not limit this.

In practice, for questions belonging to the same intention category in the dialogue design database 102, most of the next question numbers set in the continuation items are set to other questions of the same intention category. Therefore, the system can conduct more comprehensive questions for questions of the same intention category, so as to be able to grasp the user's situation in depth. In still another embodiment of the present invention, the control module 206 further includes calculating the user completion degree of each intention category. The "user completion degree" is, for example, a percentage obtained by dividing the number of questions answered by the user by the number of all questions in the category. Therefore, when the system selects the next health status assessment question, if the continuation item includes multiple candidate question numbers, the system will first determine whether the user completion degree of the intention category to which the question belongs has reached a preset threshold. If not, the system will prioritize another question that belongs to the same intent category as the current question from the continuation items, and will not select other intents until the user’s response to the intent category reaches the preset threshold. The category of questions is for the user to continue answering. Even if the user may use the "trigger keyword vocabulary" to jump the system to other intent categories in advance, the system will still return to the previous intent category and continue to ask questions after the jumped intent category is completed.

When the continuation item selected according to the current health status assessment question in the dialogue design database 102 is empty (such as Q99), the system will end the interactive question and answer. In the foregoing situation, for example, after the user has completed a certain number of interactive question and answer, the system determines that sufficient information has been collected and can continue to generate an evaluation report for the user to review, so the interactive question and answer process is left; During the question and answer, the control module 206 will provide Q99 in the dialog design database 102 to confirm whether the user has other questions, and if the user selects "No", the interactive question and answer will be ended.

According to the above-mentioned mechanism for selecting the next health status evaluation question, the interactive health status evaluation system described in an embodiment of the present invention can be closer to the user's semantic meaning and understand the user's intentions and needs. At the same time, it provides more accurate health status assessment questions based on the reply information provided by the user.

Please refer to FIG. 1B, which is a structural diagram of an interactive health assessment system according to another embodiment of the present invention, including an assessment device 10 and an interactive device 20 that are communicatively connected to each other. The communication is connected to a wired or wireless network, for example. The path connects to NC, and the present invention does not limit this.

The evaluation device 10 is, for example, a cloud platform, which includes a dialog design database 102, a recognition module 104, a semantic understanding module 106, a health status evaluation module 108, and a communication module 109. For the functions and implementation of the components 102~108, please refer to The preceding text will not be repeated here.

The communication module 109 is electrically connected to the dialog design database 102 and the health status assessment module 108. The communication module 109 converts the selected health status assessment questions and assessment reports and other information into data formats (such as network packets). Send to the interactive device 20 through the network connection NC.

In addition, the evaluation device 10 may further include a database of life resources, learning resources, content resources, etc., or a corpus, a user database, and the like. In the interactive health assessment system of an embodiment of the present invention, the user database is communicatively connected to the health assessment module 108, and the user database is used to find the corresponding use based on the user’s facial image or the user’s voice One of the storage space, and the evaluation report is stored in this storage space.

The interactive device 20 can be, for example, a mobile vehicle (such as a robot) or a mobile device (such as a smart phone or a tablet) equipped with a camera device, and the interactive health assessment system is in the form of an application (APP) Installed on the interactive device 20. The interactive device 20 includes: a data output interface 202, a multi-modal data input interface 204, a control module 206, a detection device 208, and a communication module 209. For the functions and implementations of the components 202 to 206, please refer to the foregoing, and will not be repeated here. The data output interface 202, the multi-modal data input interface 204, and the control module 206 are all communicatively connected to the communication module 209, and the control module 206 is additionally communicatively connected to the detection device 208

The detection device 208 is, for example, a camera device or a microphone, which is used to obtain an image data or an audio data, and pass the obtained data to the control module 206 to determine whether the user is detected. Specifically, when the image data has the user's face image or the voice data has the user's voice, the control module 206 uses the communication module 109 to connect to the NC from the dialog design database 102 A health status assessment question is selected, and the health status assessment question is presented through the data output interface 202.

Based on the above two embodiments, it can be seen that in addition to integrating all the components of the interactive health assessment system into the same hardware device, it also includes the three implementation manners described later.

Embodiment 1: The system is installed in a mobile vehicle with a video device. The system can detect whether a user is around through the video device, greet the user, and activate system functions through dialogue or commands. After the user operating system functions, the system records the operation history to the cloud database, and updates the functions of the system related components, and finally exports charts and reports for users to further study and reference.

Implementation mode 2: The system is installed in a mobile vehicle. The system can actively engage in dialogue and interaction with the user. Through the process of chat and dialogue and the establishment of a knowledge base, the system can understand the concepts that the user lacks and provide corresponding learning. List to the user.

Implementation mode 3: The system is installed in a mobile device, and the system can actively engage in dialogue and interaction with the user. Through the establishment of a database of related information such as the process, time, context, and life of the chat dialogue, the system can provide intelligent personalization Recommend a list to users to improve their convenience in life.

Please refer to FIG. 2, which shows an execution flow chart of an interactive health status assessment method according to an embodiment of the present invention.

Please refer to step S10: determine whether a user is detected. In detail, the detection device 208 obtains image data or audio data; the control module 206 determines whether the image data includes the user's facial image or the audio data includes the user's voice. When the image data has the user's face image or the audio data has the user's voice, the process moves to step S12, otherwise the detection device 208 continues to be used for detection. In addition to the fact that the system can actively detect the user through the detection device 208 and greet the user, the user can also directly issue a command to the system through the multi-modal data input interface 204 and start the system for dialogue.

Please refer to step S12: select and present a health status assessment question. In detail, the system selects a health status assessment question from the dialog design database 102 and presents the health status assessment question through the data output interface 202.

Please refer to Step S14: Receive reply information. In detail, the system receives the user's response information such as voice, image, or physiological measurement signal through the multi-modal data input interface 204. For example, receiving audio data through a sensing module; receiving a trigger signal through a touch screen; or receiving a Bluetooth input signal or wireless input signal through a communication module.

Please refer to Step S20: Determine the type of reply information. In detail, the system determines whether the reply information is of a numeric type or a text type through the identification module 104. When the reply information is of a numerical type, please refer to step S22, and the health status assessment module 108 generates the first evaluation result according to the reply information and the pre-stored numerical rules. On the other hand, when the reply information is of text type, please refer to steps S24 to S26. The semantic understanding module 106 retrieves keywords from the reply information, and then the health status evaluation module 108 generates a second evaluation result based on the keywords. The health status evaluation module 108 further stores at least one of the above two evaluation results in a temporary storage space.

Please refer to step S30 to determine whether the interaction end signal is received. In detail, when the interaction end signal is not received, another health status evaluation question is selected from the continued items of the health status evaluation question, and step S12 is returned. Determining whether the interaction end signal is received includes the following methods: receiving a trigger signal that represents the end of the interaction; or the continued item of the health status assessment question corresponds to zero health status assessment questions.

Conversely, when the system has received the interaction end signal, the health status evaluation module 108 outputs an evaluation report according to the data in the temporary storage space, and presents the evaluation report through the data output interface 202, as shown in step S32. In addition, before outputting the evaluation report, it can further include searching for a storage space corresponding to the user in a user database based on the user’s facial image or the user’s voice; and then storing the evaluation report in the storage corresponding to the current user space.

In summary, the interactive health status assessment system and method of the present invention can be imported into a home robot or APP, and applied to the home, so as to alleviate the companionship needs of an aging society and long-term photos. In addition, it can also be applied to the medical care field to replace the medical staff in repetitive health education, so that the medical staff can focus on the individual care of patients to improve and optimize the quality of medical care.

Although the present invention is disclosed as the foregoing embodiments, it is not intended to limit the present invention. Without departing from the spirit and scope of the present invention, all modifications and retouching are within the scope of the patent protection of the present invention. For the protection scope defined by the present invention, please refer to the attached patent application scope.

10: Evaluation device 102: Dialogue design database 104: Identification module 106: Semantic understanding module 108: Health status assessment module 109: Communication module NC: Network connection 20: Interactive device 202: Data output interface 204: Multi-modal data input interface 206: Control module 208: Detection device 209: Communication module S10~S32: Step

FIG. 1A is a structural diagram of an interactive health assessment system according to an embodiment of the present invention. FIG. 1B is a schematic diagram of an interactive health assessment system according to another embodiment of the present invention. FIG. 2 is a flowchart shown in an interactive health assessment method according to an embodiment of the invention.

10: Evaluation device

102: Dialogue Design Database

104: Identification Module

106: Semantic Understanding Module

108: Health Assessment Module

109: Communication module

NC: Internet connection

20: Interactive installation

202: Data output interface

204: Multi-modal data input interface

206: Control Module

208: Detection Device

209: Communication module

Claims (11)

An interactive health status evaluation method includes: selecting a health status evaluation question from a dialog design database and presenting the health status evaluation problem through a data output interface, wherein the dialog design database includes a plurality of health status evaluation questions, Each of the health status assessment questions has a continuation item corresponding to zero or at least another health status assessment question in the dialogue design database; after the health status assessment question is presented on the data output interface , Receive a reply information through a multi-modal data input interface; use a recognition process to determine the type of the reply information; when the reply information is of a numeric type, use a health assessment process to generate a response information and a numerical rule The first evaluation result and the storage of the first evaluation result in a temporary storage space; when the response information is of text type, a semantic understanding process is used to extract a keyword from the response information, and the health status assessment process is based on the The keyword generates a second evaluation result and stores the second evaluation result in the temporary storage space; and after the first evaluation result or the second evaluation result is generated, it is determined whether an interaction end signal is received; when it has been received When the interaction end signal, an evaluation report is output according to the data in the temporary storage space by the health status evaluation program; when the interaction end signal is not received, another health status evaluation question is selected, and the other health status evaluation The question is selectively selected from the continuation item. According to the interactive health status assessment method of claim 1, wherein each of the health status evaluation questions has a response keyword corresponding to the continued item, and selecting the other health status evaluation question further includes: When the keyword matches the response keyword vocabulary, select the continuation item corresponding to the response keyword vocabulary. According to the interactive health status evaluation method of claim 1, wherein each of the health status evaluation questions has a trigger key word, and selecting the other health status evaluation question further includes: from among the health status evaluation questions Finding a match with the keyword in the trigger keyword vocabulary serves as the other health status assessment question. The interactive health status assessment method according to claim 1, wherein before selecting the health status assessment question from the dialog design database, it further includes: obtaining an image data or a sound data by a detection device; and determining the Whether the image data has a user's face image or the audio data has the user's voice; when the image data has the user's face image or the audio data has the user's voice , It starts to select the health status assessment question from the dialogue design database. The interactive health status assessment method of claim 1, wherein determining whether the interaction end signal is received includes the following methods: receiving a trigger signal that represents the end of the interaction; or the continued item of the health status assessment question corresponds to zero A health status assessment question. The interactive health status evaluation method of claim 4, wherein before outputting the evaluation report, it further includes: searching a user database based on the user’s facial image or the user’s voice. One of the storage space; and storing the assessment report in the storage space. An interactive health status assessment system, comprising: a dialog design database, including a plurality of health status assessment questions, each of the health status assessment questions has a continuation item, and the continuation item corresponds to the dialog design database Zero or at least another health assessment question; a data output interface for communicating with the dialog design database, the data output interface for presenting the health assessment question; a multimodal data input interface for receiving a Reply information; an identification module, which is communicatively connected to the multi-modal data input interface, the identification module is used to determine whether the reply information belongs to a text type or a numerical type; a semantic understanding module, which is communicatively connected to the identification module, the semantics The comprehension module is used to extract a keyword from the reply information belonging to the text type; a health status assessment module is communicatively connected to the recognition module and the semantic understanding module, and the health status assessment module is used to subordinate The response information of the numerical state and a numerical rule generate a first evaluation result, generate a second evaluation result based on the keyword, store the first and second evaluation results in a temporary storage space, and generate a second evaluation result based on the temporary storage space. Data output an evaluation report; and a control module, which communicates with the dialog design database, the multi-modal data input interface and the health evaluation module, the control module is used to notify when an interaction completion signal is received The health status evaluation module outputs the evaluation report, and selects another health status evaluation question when the interaction completion signal is not received, wherein the other health status evaluation question is selectively selected from the continuation item. According to the interactive health status evaluation system of claim 7, wherein each of the health status evaluation questions further has a response keyword vocabulary corresponding to the continued item, and the control module is further used to determine whether the keyword matches the The response keyword vocabulary, and when the keyword matches the response keyword vocabulary, select the continuation item corresponding to the response keyword vocabulary. According to the interactive health status evaluation system of claim 7, wherein each of the health status evaluation questions further has a triggering keyword vocabulary, and the control module is further used to obtain the triggering keyword vocabulary from the health status evaluation questions Find those that match the keyword as the other health status assessment question. For example, the interactive health assessment system according to claim 7, further comprising: a detection device, which is communicatively connected to the control module, the detection device is used to obtain an image data or an audio data; the control module further The communication is connected to the data output interface, and is further used to determine whether the image data has a user's face image or whether the audio data has the user's voice, when the image data has the user's face When the user's voice is included in the video or the audio data, the control module further includes selecting the health status assessment question from the dialogue design database and presenting the health status assessment question through the data output interface. According to claim 8, the interactive health status assessment system further includes: a user database, which is communicatively connected to the health status assessment module, and the user database is used for the user’s facial image or the usage The user’s voice searches for a storage space corresponding to the user, and stores the evaluation report in the storage space.

Images