TWI659429B - System and method of interactive health assessment - Google Patents

System and method of interactive health assessment Download PDF

Info

Publication number
TWI659429B
TWI659429B TW107143071A TW107143071A TWI659429B TW I659429 B TWI659429 B TW I659429B TW 107143071 A TW107143071 A TW 107143071A TW 107143071 A TW107143071 A TW 107143071A TW I659429 B TWI659429 B TW I659429B
Authority
TW
Taiwan
Prior art keywords
health status
evaluation
assessment
question
health
Prior art date
Application number
TW107143071A
Other languages
Chinese (zh)
Other versions
TW202022891A (en
Inventor
蔣榮先
楊珮菁
Original Assignee
國立成功大學
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 國立成功大學 filed Critical 國立成功大學
Priority to TW107143071A priority Critical patent/TWI659429B/en
Application granted granted Critical
Publication of TWI659429B publication Critical patent/TWI659429B/en
Publication of TW202022891A publication Critical patent/TW202022891A/en

Links

Landscapes

  • Medical Treatment And Welfare Office Work (AREA)

Abstract

一種互動式健康狀態評估系統,包括:一對話設計資料庫,其具有複數個健康狀態評估問題並且透過資料輸出介面呈現;一多模態資料輸入介面,用以接收答覆資訊;一辨識模組,用以判斷答覆資訊的類型;一語意理解模組,從文字類型的答覆資訊中擷取關鍵字,一健康狀態評估模組,根據數值狀態的答覆資訊產生第一評估結果、根據關鍵字產生第二評估結果及根據評估結果輸出評估報告;一控制模組選擇性地通知健康狀態評估模組輸出評估報告或從健康狀態評估問題的續接項目中選擇另一健康狀態評估問題。An interactive health status assessment system includes: a dialogue design database with multiple health status assessment questions and presentation through a data output interface; a multi-modal data input interface for receiving response information; an identification module, Used to determine the type of response information; a semantic understanding module that extracts keywords from the response information of the text type; a health status evaluation module that generates a first evaluation result based on the response information of the numerical status and a first evaluation result based on the keyword Two evaluation results and output of an evaluation report according to the evaluation results; a control module selectively notifies the health status evaluation module to output an evaluation report or select another health status evaluation question from a continuation item of the health status evaluation question.

Description

互動式健康狀態評估系統及其方法Interactive health state assessment system and method

本發明係關於健康狀態評估,特別是一種互動式健康狀態評估系統及其方法。The invention relates to health status assessment, in particular to an interactive health status assessment system and method.

高齡化社會的到來,讓銀髮族的長期照護,成為現代社會及家庭最關心的議題之一。另一方面,在機器人與人工智慧交互推動的快速發展下,能提供的服務也越來越多元化,例如具有居家健康照護與陪伴功能的機器人能協助子女照顧家中長輩或獨居長者,將高齡照護工作予以科技化的方式可舒緩長照人口缺乏的壓力。在醫療照護場所中,機器人可協助醫護人員進行重複性高的衛生教育,讓醫療人員可更專心於病患的個別照護需求,以提升並優化醫療品質。With the advent of an aging society, the long-term care of the silver-haired people has become one of the most concerned issues in modern society and families. On the other hand, under the rapid development of the interaction between robots and artificial intelligence, the services that can be provided are becoming more and more diversified. For example, robots with home health care and companion functions can help children take care of elders at home or elders living alone. Technological approaches to care work can alleviate the stress of a lack of a long-term population. In medical care places, robots can help medical staff to carry out highly repetitive health education, allowing medical staff to focus more on the individual care needs of patients in order to improve and optimize medical quality.

然而,現有結合人工智慧與健康照護的系統缺乏與被照護對象的互動機制。由於中文對話沒有明確的字詞分界,因此若上述系統之軟體層面缺少深度語意理解的設計,在和使用者口語對談時,往往難以準確偵測到使用者意圖。只能依靠相似物品或相似使用者輔助判斷,未能確實根據當前使用者偏好、因果關係與情境等因素,提供更智慧的健康評估結果。However, the existing systems combining artificial intelligence and health care lack an interaction mechanism with the care-giving object. Because there is no clear word boundary in Chinese dialogues, if the software level of the above system lacks a deep semantic understanding design, it is often difficult to accurately detect the user's intention when talking with the user's spoken language. It can only rely on similar items or similar user-assisted judgments, and fail to provide smarter health assessment results based on factors such as current user preferences, causality, and context.

有鑑於此,本發明提出一種互動式健康評估系統及互動式健康評估方法,藉此解決上述的問題。In view of this, the present invention proposes an interactive health assessment system and an interactive health assessment method, thereby solving the aforementioned problems.

依據本發明一實施例所敘述的互動式健康狀態評估方法,包括:從對話設計資料庫中選取一健康狀態評估問題並以資料輸出介面呈現此健康狀態評估問題,其中對話設計資料庫包括複數個健康狀態評估問題,每一健康狀態評估問題具有一續接項目,續接項目對應至對話設計資料庫中的零個或至少另一個健康狀態評估問題;在資料輸出介面呈現健康狀態評估問題之後,多模態資料輸入介面接收答覆資訊;辨識程序判斷答覆資訊之類型;當答覆資訊屬於數值類型時,健康狀態評估程序根據答覆資訊及數值規則產生第一評估結果及儲存第一評估結果於暫存空間;當答覆資訊屬於文字類型時,語意理解程序從答覆資訊中擷取關鍵字,健康狀態評估程序根據此關鍵字產生第二評估結果及儲存第二評估結果於暫存空間;以及在產生第一評估結果或第二評估結果之後,判斷是否收到互動結束訊號;當已收到互動結束訊號時,健康狀態評估程序根據暫存空間中的資料輸出評估報告;當未收到互動結束訊號時,從健康狀態評估問題的續接項目中選擇另一健康狀態評估問題。The interactive health assessment method according to an embodiment of the present invention includes: selecting a health assessment question from a dialogue design database and presenting the health assessment question through a data output interface, wherein the dialogue design database includes a plurality of Health status assessment questions. Each health status assessment question has a continuation item, which corresponds to zero or at least another health status assessment question in the dialogue design database; after the health status assessment question is presented in the data output interface, The multi-modal data input interface receives response information; the identification process determines the type of response information; when the response information is of a numerical type, the health status evaluation process generates a first evaluation result according to the response information and numerical rules and stores the first evaluation result in a temporary storage Space; when the response information is a text type, the semantic understanding process extracts keywords from the response information, and the health status evaluation process generates a second evaluation result based on this keyword and stores the second evaluation result in the temporary storage space; First evaluation result or second evaluation result Then, determine whether the end of interaction signal has been received; when the end of interaction signal has been received, the health status assessment program outputs an evaluation report based on the data in the temporary storage space; when the end of interaction signal is not received, the health status assessment problem Select another health assessment question in the connection project.

依據本發明一實施例所敘述的互動式健康狀態評估系統,包括:對話設計資料庫,包括複數個健康狀態評估問題,每一健康狀態評估問題具有續接項目,續接項目對應至對話設計資料庫中的零個或至少另一個健康狀態評估問題;資料輸出介面,通訊連接對話設計資料庫,資料輸出介面用以呈現健康狀態評估問題;多模態資料輸入介面,用以接收答覆資訊;辨識模組,通訊連接多模態資料輸入介面,辨識模組用以判斷答覆資訊屬於文字類型或數值類型;語意理解模組,通訊連接辨識模組,語意理解模組用以從屬於文字類型的答覆資訊中擷取一關鍵字;健康狀態評估模組,通訊連接辨識模組及語意理解模組,健康狀態評估模組用以從屬於數值狀態的答覆資訊及一數值規則產生第一評估結果、根據關鍵字產生第二評估結果、儲存第一及第二評估結果至一暫存空間及根據暫存空間之資料輸出評估報告;以及控制模組,通訊連接對話設計資料庫、多模態資料輸入介面及健康狀態評估模組,控制模組用以在收到互動完成訊號時通知健康狀態評估模組輸出評估報告,及在未收到互動完成訊號時從健康狀態評估問題的續接項目中選擇另一健康狀態評估問題。The interactive health assessment system according to an embodiment of the present invention includes a dialogue design database including a plurality of health assessment questions. Each health assessment question has a continuation item, and the continuation item corresponds to the dialogue design data. Zero or at least one health assessment question in the database; data output interface, communication connection dialogue design database, data output interface for presenting health status assessment questions; multi-modal data input interface for receiving response information; identification Module, communication connection multi-modal data input interface, identification module is used to determine whether the response information is text type or numerical type; semantic understanding module, communication connection identification module, semantic understanding module is used to respond to text type responses Extract a keyword from the information; health status evaluation module, communication connection identification module and semantic understanding module, health status evaluation module is used to generate the first evaluation result from the response information belonging to the numerical status and a numerical rule. Keywords generate second evaluation results, store first and second evaluation results in one Storage space and output evaluation report based on the data of the temporary storage space; and control module, communication connection dialogue design database, multi-modal data input interface and health status evaluation module, the control module is used when receiving the interaction completion signal Notify the health status evaluation module to output an evaluation report, and select another health status evaluation question from the continuation items of the health status evaluation question when no interactive completion signal is received.

藉由上述架構,本發明所揭露的互動式健康狀態評估系統及其方法,可透過使用者對話,理解其語意與更了解使用者意圖與需求。With the above structure, the interactive health assessment system and method disclosed by the present invention can understand the semantics of the user and better understand the user's intentions and needs through the user's dialogue.

以上之關於本揭露內容之說明及以下之實施方式之說明係用以示範與解釋本發明之精神與原理,並且提供本發明之專利申請範圍更進一步之解釋。The above description of the contents of this disclosure and the description of the following embodiments are used to demonstrate and explain the spirit and principle of the present invention, and provide a further explanation of the scope of the patent application of the present invention.

以下在實施方式中詳細敘述本發明之詳細特徵以及優點,其內容足以使任何熟習相關技藝者了解本發明之技術內容並據以實施,且根據本說明書所揭露之內容、申請專利範圍及圖式,任何熟習相關技藝者可輕易地理解本發明相關之目的及優點。以下之實施例係進一步詳細說明本發明之觀點,但非以任何觀點限制本發明之範疇。The detailed features and advantages of the present invention are described in detail in the following embodiments. The content is sufficient for any person skilled in the art to understand and implement the technical contents of the present invention. Anyone skilled in the relevant art can easily understand the related objects and advantages of the present invention. The following examples further illustrate the viewpoints of the present invention in detail, but do not limit the scope of the present invention in any way.

本發明所揭露的互動式健康狀態評估系統及其方法,除了特別注重系統與使用者之間的互動性,更進一步透過本發明設計的互動式問答掌握使用者的健康狀態。下文先說明本發明的互動式健康狀態評估系統的一種硬體架構實施例及系統中各元件的功用,再介紹另一種硬體架構實施例及其應用場景,最後介紹基於本系統執行的互動式健康狀態評估方法。The interactive health status assessment system and method disclosed in the present invention, besides paying particular attention to the interaction between the system and the user, further grasp the user's health status through the interactive question and answer designed by the present invention. The following first describes an embodiment of the hardware architecture of the interactive health assessment system of the present invention and the functions of the components in the system, then introduces another embodiment of the hardware architecture and its application scenarios, and finally introduces the interactive implementation based on this system. Method of health assessment.

請參考圖1A,其係繪示本發明一實施例的互動式健康狀態評估系統,包括:對話設計資料庫102、辨識模組104、語意理解模組106、健康狀態評估模組108、資料輸出介面202、多模態資料輸入介面204及控制模組206。用以實現上述元件的硬體設備可整合於同一裝置中,所述同一裝置例如係一互動式機器人,本發明對此不予限制Please refer to FIG. 1A, which illustrates an interactive health assessment system according to an embodiment of the present invention, including: a dialogue design database 102, a recognition module 104, a semantic understanding module 106, a health assessment module 108, and data output. The interface 202, the multi-modal data input interface 204, and the control module 206. The hardware equipment used to implement the above components can be integrated in the same device, for example, the same device is an interactive robot, which is not limited in the present invention.

對話設計資料庫102係以資料表型態儲存複數個健康狀態評估問題。每一健康狀態評估問題具有一續接項目。續接項目對應至對話設計資料庫102中的零個或至少另一個健康狀態評估問題。在一實施例中,每一健康狀態評估問題更具有一應答關鍵詞彙對應於續接項目。在另一實施例中,每一健康狀態評估問題更具有一觸發關鍵詞彙。The dialogue design database 102 stores a plurality of health assessment questions in a data table format. Each health status assessment question has a continuation item. The continuation item corresponds to zero or at least one other health status assessment question in the dialogue design database 102. In one embodiment, each health status assessment question has a response key word corresponding to the continuation item. In another embodiment, each health status assessment question has a trigger keyword pool.

請參考下方表一,其係對話設計資料庫102中的資料表範例。在一實施例中,對話設計資料庫102中的所有健康狀態評估問題分屬於多種意圖,如睡眠、血糖、血壓、結束對答…等。在資料表中,每個健康狀態評估問題對應至一編號及一提問腳本。資料表中其餘欄位的用途將於後文述及其他模組的功能時一併敘述之。Please refer to Table 1 below, which is an example of a data table in the dialog design database 102. In one embodiment, all the health status assessment questions in the dialogue design database 102 belong to multiple intents, such as sleep, blood glucose, blood pressure, end of answer, etc. In the data sheet, each health assessment question corresponds to a number and a questioning script. The purpose of the remaining fields in the data table will be described in the following sections and the functions of other modules.

表一:對話設計資料庫102之資料表範例。 意圖 編號 提問腳本 觸發關鍵詞彙 應答關鍵詞彙 對答腳本 續接項目 睡眠 Q1 你昨晚睡得好嗎? 睡得好、睡得飽是保持清醒和精力充沛的好方法。 Q7 不好、不怎麼好、很差、差 糟糕、很糟 Q3 Q5 Q3 你昨晚睡前是不是有喝含咖啡因的飲品? 睡覺、不好、差、糟糕 是、有 Q7 不是、沒有 Q5 Q5 你昨晚睡前是不是有滑手機、看電腦? 睡覺、不好、差、糟糕 Q7 不是 Q7 血糖 Q7 心悸、手抖、冒冷汗 Q9 結束 Q99 還有其他問題嗎? 結束 有、是 Q11 Q21 Q31 沒、否 Table 1: An example of a data table for the dialog design database 102. intention Numbering Question script Keyword Trigger Response Keyword Answer script Succession project Sleep Q1 Did you sleep well last night? no it is good Sleeping well and sleeping well is a great way to stay awake and full of energy. Q7 Bad, not good, bad, bad, bad Q3 Q5 Q3 Did you drink caffeinated drinks before going to bed last night? Sleep, bad, bad, bad there is ... Q7 Not without ... Q5 Q5 Did you slide your phone and watch your computer before going to bed last night? Sleep, bad, bad, bad Yes ... Q7 Is not ... Q7 blood sugar Q7 ... Palpitations, shaking hands, cold sweats ... ... ... Q9 ... ... ... ... ... ... ... ... ... ... ... ... End Q99 Do you have any other questions? End Yes, yes ... Q11 Q21 Q31 No, no ... air

請繼續參考圖1A。資料輸出介面202通訊連接對話設計資料庫102,資料輸出介面202用於呈現被選擇的健康狀態評估問題給使用者觀看或聆聽。實務上,資料輸出介面202例如螢幕或喇叭,以文字、圖像、動畫的方式顯示或以語音播放被選擇的健康狀態評估問題,本發明對於資料輸出介面202的硬體類型以及輸出問題的媒體型態並不限制。Please continue to refer to FIG. 1A. The data output interface 202 is communicatively connected to the dialogue design database 102. The data output interface 202 is used to present selected health status assessment questions for the user to watch or listen to. In practice, the data output interface 202, such as a screen or a speaker, is displayed in text, image, or animation mode or is played by voice. The selected health status assessment questions are provided. The present invention provides information on the hardware type of the data output interface 202 and the media in which the problem occurs The pattern is not restricted.

在使用者從資料輸出介面202獲知一健康狀態評估問題之後,本發明一實施例的互動式健康狀態評估系統提供一多模態資料輸入介面204接收來自使用者的答覆資訊。實務上,多模態資料輸入介面204可採用的硬體裝置例如:麥克風、攝像裝置、觸控式螢幕、生理資訊量測儀器(如血糖機)或電腦週邊裝置;其用以接收答覆資訊的輸出方式例如為:語音輸入、影像輸入、點擊螢幕輸入、藍牙傳輸或無線傳輸;答覆資訊之資料格式包括:聲音、影像、觸發訊號、文字或數字等。After the user learns a health assessment problem from the data output interface 202, the interactive health assessment system of an embodiment of the present invention provides a multi-modal data input interface 204 to receive response information from the user. In practice, the hardware devices that can be used in the multi-modal data input interface 204 are, for example, microphones, video cameras, touch screens, physiological information measuring instruments (such as blood glucose meters), or computer peripherals; The output methods are, for example: voice input, video input, tap screen input, Bluetooth transmission or wireless transmission. The data format of the reply information includes: sound, image, trigger signal, text or number.

請繼續參考圖1A。辨識模組104通訊連接多模態資料輸入介面204,辨識模組104用於執行一辨識程序,所述的辨識程序例如係運行於處理器上的軟體或程式碼。辨識程序用於判斷該答覆資訊屬於文字類型或數值類型。例如將麥克風(多模態資料輸入介面204)收到的語音訊號轉換為文字,或是將血糖機量測的電子訊號轉換為數值。數值類型的資料例如代表生命徵象(Vital Signs)的體溫、血壓、心律及呼吸速度。或是生理數據例如血糖、血脂等。Please continue to refer to FIG. 1A. The identification module 104 is communicatively connected to the multi-modal data input interface 204. The identification module 104 is configured to execute an identification program, such as software or code running on a processor. The identification process is used to determine whether the response information is a text type or a numeric type. For example, the voice signal received by the microphone (multi-modal data input interface 204) is converted into text, or the electronic signal measured by the blood glucose meter is converted into a value. Value-type data such as body temperature, blood pressure, heart rate, and breathing rate that represent Vital Signs. Or physiological data such as blood glucose, blood lipids, etc.

請繼續參考圖1A。語意理解模組106通訊連接辨識模組104,語意理解模組用於執行一語意理解程序,所述的語意理解程序例如係運行於處理器上的軟體或程式碼或一具有多個關鍵字的資料庫。語意理解程序用於從屬於文字類型的答覆資訊中擷取一或數個關鍵字。藉由類神經網路或機器學習的方式實現語法和語意分析。Please continue to refer to FIG. 1A. The semantic understanding module 106 communicates with the identification module 104. The semantic understanding module is configured to execute a semantic understanding program, such as software or code running on a processor or a multi-keyword database. The semantic comprehension process is used to extract one or more keywords from the response information that is a text type. Grammar and semantic analysis through neural network-like or machine learning.

請繼續參考圖1A。健康狀態評估模組108通訊連接辨識模組104及語意理解模組106,健康狀態評估模組用於執行一健康狀態評估程序,所述的健康狀態評估程序例如係運行於處理器上的軟體或程式碼。健康狀態評估程序用於從屬於數值狀態的答覆資訊及一數值規則產生第一評估結果。舉例來說,根據血糖機量測到的數值與預先儲存的正常範圍血糖值(數值規則)進行比對以產生第一評估結果。另外,當語意理解模組106擷取出關鍵字時,健康狀態評估模組108也用於根據關鍵字及從對話設計資料庫102選取的健康狀態評估問題產生第二評估結果。Please continue to refer to FIG. 1A. The health status evaluation module 108 communicates with the identification module 104 and the semantic understanding module 106. The health status evaluation module is configured to execute a health status evaluation program. The health status evaluation program is, for example, software running on a processor or Code. The health state evaluation program is used to generate a first evaluation result from the response information and a numerical rule belonging to the numerical state. For example, a value measured by the blood glucose meter is compared with a pre-stored normal range blood glucose value (value rule) to generate a first evaluation result. In addition, when the semantic understanding module 106 retrieves keywords, the health evaluation module 108 is also used to generate a second evaluation result based on the keywords and the health evaluation problems selected from the dialog design database 102.

在每次多模態資料輸入介面204獲取使用者輸入的資訊時,健康狀態評估模組108皆會產生第一評估結果及第二評估結果其中至少一者,並將評估結果儲存於一暫存空間。換句話說,每次使用者的答覆除了僅包括文字型資料或數值型資料之外,亦有可能同時包含上述兩者。舉例來說:使用者告知系統「我昨晚睡得不好,應該有發燒超過38度」。在此範例中,健康狀態評估模組108將根據「睡」、「不好」等關鍵字產生第二評估結果,並且根據「38度」此數值資料產生第一評估結果。當本發明一實施例的互動式健康狀態評估系統偵測到使用者完成健康狀態評估流程時,或是偵測到使用者自行中斷健康狀態評估流程時,健康狀態評估模組108將根據暫存空間儲存的資料輸出評估報告。在本發明另一實施例中,互動式健康狀態評估系統可更包括一使用者資料庫,用於儲存每個使用者的歷史評估報告。因此每當使用者透過本系統產生新的評估報告時,健康狀態評估模組108可更納入先前的歷史資料一併計算,藉此更能精準地反映使用者的健康狀態。Each time the multi-modal data input interface 204 obtains the information input by the user, the health status evaluation module 108 generates at least one of the first evaluation result and the second evaluation result, and stores the evaluation result in a temporary storage. space. In other words, each user ’s response may include both text and numeric data, as well as both. For example: The user told the system "I didn't sleep well last night. I should have a fever of over 38 degrees." In this example, the health evaluation module 108 will generate a second evaluation result based on the keywords "sleep" and "bad", and generate a first evaluation result based on the numerical data of "38 degrees". When the interactive health status assessment system according to an embodiment of the present invention detects that the user completes the health status assessment process, or detects that the user interrupts the health status assessment process by itself, the health status assessment module 108 will temporarily store The data stored in the space output an evaluation report. In another embodiment of the present invention, the interactive health assessment system may further include a user database for storing a historical evaluation report of each user. Therefore, whenever a user generates a new evaluation report through the system, the health status evaluation module 108 may further include the previous historical data and calculate together, thereby more accurately reflecting the health status of the user.

請繼續參考圖1A。控制模組206通訊連接對話設計資料庫102、多模態資料輸入介面204及健康狀態評估模組108,藉此整合上述元件執行互動式健康狀態評估流程。實務上,控制模組206例如係運行於處理器上的軟體或程式碼。在收到互動完成訊號時,控制模組206通知健康狀態評估模組108輸出評估報告;在未收到互動完成訊號時,控制模組206從健康狀態評估問題的續接項目中選擇另一健康狀態評估問題。互動完成訊號係使用者透過多模態資料輸入介面204產生,例如按壓觸控式螢幕上的返回鍵或是對麥克風說出「結束互動」;亦可由系統自行偵測到下述狀況而產生:例如使用者已針對對話設計資料庫102一定數量的健康狀態評估問題進行答覆而達到一定的互動程度。Please continue to refer to FIG. 1A. The control module 206 communicates with the dialog design database 102, the multi-modal data input interface 204, and the health status evaluation module 108, thereby integrating the above components to perform an interactive health status evaluation process. In practice, the control module 206 is, for example, software or code running on a processor. When the interaction completion signal is received, the control module 206 notifies the health status evaluation module 108 to output an evaluation report; when the interaction completion signal is not received, the control module 206 selects another health from the continuation items of the health status evaluation question Condition assessment issues. The interaction completion signal is generated by the user through the multi-modal data input interface 204, such as pressing the return key on the touch screen or saying "end interaction" to the microphone; it can also be generated by the system detecting the following conditions: For example, the user has responded to a certain number of health assessment questions of the dialogue design database 102 to achieve a certain degree of interaction.

以下說明控制模組206如何選擇另一健康狀態評估問題的方式。在本發明另一實施例中,控制模組206更包括:判斷關鍵字是否符合應答關鍵詞彙,並且在關鍵字符合應答關鍵詞彙時選擇應答關鍵詞彙對應之續接項目。請回顧表一,舉例來說,當目前被選擇的問題為Q3:「你昨晚睡前是不是有喝含咖啡因的飲品?」時,Q3所對應的應答關鍵詞彙包含「是」與「不是」,因此當控制模組206確認語意理解模組106擷取出的關鍵字包含「是」或「有」的時候,則根據表一中Q3的續接項目欄位選擇Q7作為下一個要提問使用者的健康狀態評估問題。當續接項目欄位中具有複數個問題編號時,則從中隨機挑選一者作為下一個健康狀態評估問題,或是將這些問題排入佇列中依序詢問使用者。The following describes how the control module 206 selects another method for evaluating the health status. In another embodiment of the present invention, the control module 206 further includes: judging whether the keyword matches the response keyword sink, and selecting a continuation item corresponding to the response keyword sink when the keyword matches the response keyword sink. Please review Table 1. For example, when the currently selected question is Q3: "Did you drink caffeinated drinks before going to bed last night?", The response key words corresponding to Q3 include "yes" and " No ", so when the control module 206 confirms that the keywords extracted by the semantic understanding module 106 include" yes "or" yes ", it selects Q7 as the next question according to the continuation item field of Q3 in Table 1. User health assessment issues. When there are multiple question numbers in the continuation item field, one of them is randomly selected as the next health status assessment question, or these questions are queued to ask the user in order.

在本發明又一實施例中,控制模組206更包括:從健康狀態評估問題中之觸發關鍵詞彙中尋找與關鍵字相符者作為另一健康狀態評估問題。舉例來說:當目前被選擇的問題為Q3時,使用者並未直接問答問題,而是敘述自己昨晚「冒冷汗」。當控制模組206確認語意理解模組106擷取出的關鍵字包含「冒冷汗」的時候,則檢索表一中所有「觸發關鍵詞彙」並尋獲Q7,故選擇Q7作為下一個要提問使用者的健康狀態評估問題。實務上,當使用者的答覆訊號中同時包含「觸發關鍵詞彙」與「應答關鍵詞」,可根據兩者之優先次序而決定下一個被選擇的健康評估問題為何者,或是從中隨機挑選一者先行提問使用者,本發明對此不予限制。In another embodiment of the present invention, the control module 206 further includes: searching for a keyword match from the trigger keyword pool in the health status assessment question as another health status assessment question. For example: When the currently selected question is Q3, the user did not directly answer the question, but described himself as "sweating" last night. When the control module 206 confirms that the keywords extracted by the semantic comprehension module 106 contain "sweating sweat", it searches all the "trigger keywords" in Table 1 and finds Q7, so Q7 is selected as the next user Health assessment issues. In practice, when the user ’s response signal contains both “trigger keyword collection” and “response keyword”, the next selected health assessment question can be determined according to the priority of the two, or one of them can be randomly selected. The user first asks the user, and the present invention does not limit this.

實務上,在對話設計資料庫102中屬於同一個意圖類別的問題,其續接項目中設定的下一個問題編號,大部分被設定為相同意圖類別的其他問題。因此,系統可針對同一意圖類別的問題進行較為全面的提問,以便能深入掌握使用者的狀況。在本發明再一實施例中,控制模組206更包括計算每一意圖類別的使用者完成度。所述的「使用者完成度」例如係以使用者完成回答的問題數量除以該類別所有問題的數量而得到一百分比。因此,系統在選擇下一個健康狀態評估問題時,若其續接項目中包括多個候選問題編號,則系統會先行判斷本問題所屬之意圖類別的使用者完成度是否達到一預設門檻值。若否,則系統將從續接項目中優先挑選與當前問題屬於同一個意圖類別的另一問題,直到使用者對於該意圖類別的回答完成度達到該預設門檻值後,系統才選擇其他意圖類別的問題供使用者繼續回答。即使使用者可能透過「觸發關鍵詞彙」先行讓系統跳轉到其他意圖類別的問題,然而系統仍會在所跳轉的意圖類別的完成度達到之後,返回前一個意圖類別的其他問題繼續提問。In practice, in the dialog design database 102, questions that belong to the same intent category, and the next question numbers set in the continuation items are mostly set as other questions in the same intent category. Therefore, the system can ask more comprehensive questions about the same type of intent in order to understand the user's situation. In yet another embodiment of the present invention, the control module 206 further includes calculating a user completion degree for each intent category. The "user completion" is, for example, a percentage obtained by dividing the number of questions answered by the user by the number of all questions in the category. Therefore, when the system selects the next health assessment question, if its continuation items include multiple candidate question numbers, the system will first determine whether the user completion degree of the intended category to which the question belongs has reached a preset threshold. If not, the system will prioritize another question that belongs to the same intent category as the current question from the continuation items, and the system will not select other intents until the user's response to the intent category reaches the preset threshold. Questions in categories for users to continue to answer. Even if the user may use the "trigger keyword collection" to first make the system jump to other intent categories, the system will still return to the previous intent category to continue asking questions after the completion of the jumped intent category is completed.

當對話設計資料庫102中根據當前的健康狀態評估問題選擇到的續接項目為空時(如Q99),系統將結束互動時問答。前述情況例如在使用者完成一定數量的互動式問答後,系統判定已收集足夠的資訊,可繼續產生評估報告供使用者檢閱,因此離開互動式問答的流程;或是例如使用者想中斷互動式問答時,控制模組206將提供對話設計資料庫102中的Q99確認使用者是否還有其他問題,若使用者選擇「否」,則結束互動式問答。When the continuation item selected in the dialogue design database 102 according to the current health status assessment question is empty (such as Q99), the system will end the interactive Q & A. In the foregoing case, for example, after the user completes a certain number of interactive Q & As, the system determines that sufficient information has been collected, and can continue to generate an evaluation report for the user to review, thus leaving the interactive Q & A process; or, for example, the user wants to interrupt the interactive Q & A During the question and answer, the control module 206 will provide Q99 in the dialogue design database 102 to confirm whether the user has any other questions. If the user selects "No", the interactive question and answer is ended.

根據上述選擇下一個健康狀態評估問題的機制,本發明一實施例所敘述的互動式健康狀態評估系統得以更貼近使用者的語意,了解使用者的意圖與需求。同時根據使用者提供的答覆資訊,提供更精確的健康狀態評估問題。According to the above mechanism for selecting the next health status assessment question, the interactive health status assessment system described in an embodiment of the present invention can be closer to the user's semantic meaning and understand the user's intentions and needs. At the same time, provide more accurate health assessment questions based on the response information provided by users.

請參考圖1B,其係繪示本發明另一實施例的互動式健康狀態評估系統的架構圖,包括互相通訊連接的評估裝置10及互動裝置20,所述的通訊連接例如有線或無線的網路連線NC,本發明對此不予限制。Please refer to FIG. 1B, which is a structural diagram of an interactive health assessment system according to another embodiment of the present invention, including an evaluation device 10 and an interactive device 20 that are communicatively connected to each other, such as a wired or wireless network. The line connects the NC, which is not limited in the present invention.

評估裝置10例如是雲端平台,其中包括對話設計資料庫102、辨識模組104、語意理解模組106、健康狀態評估模組108及通訊模組109,元件102~108之功能與實施方式請參考前文,於此不贅述。The evaluation device 10 is, for example, a cloud platform, which includes a dialogue design database 102, an identification module 104, a semantic understanding module 106, a health evaluation module 108, and a communication module 109. For the functions and implementation methods of components 102 to 108, please refer to I will not go into details here.

通訊模組109電性連接對話設計資料庫102及健康狀態評估模組108,通訊模組109將被選取的健康狀態評估問題以及評估報告等資訊進行資料格式的轉換(例如網路封包),以便透過網路連線NC發送至互動裝置20。The communication module 109 is electrically connected to the dialogue design database 102 and the health evaluation module 108. The communication module 109 converts the selected health evaluation question and evaluation report and other information into a data format (such as a network packet) so that NC is sent to the interactive device 20 via a network connection.

另外,評估裝置10可更包括例如生活資源、學習資源、內容資源等資料庫,或是語料庫、使用者資料庫等。在本發明一實施例的互動式健康狀態評估系統中,使用者資料庫通訊連接健康狀態評估模組108,使用者資料庫用以根據使用者之臉部影像或使用者之語音尋找對應該使用者之一儲存空間,並將評估報告儲存於此儲存空間。In addition, the evaluation device 10 may further include a database such as a living resource, a learning resource, a content resource, or a corpus, a user database, and the like. In the interactive health assessment system according to an embodiment of the present invention, the user database is communicatively connected to the health assessment module 108, and the user database is used to find the corresponding use according to the user's face image or the user's voice One of the storage spaces, and the evaluation report is stored in this storage space.

互動裝置20例如是可配合搭載攝像裝置的行動載具(例如:機器人)或行動裝置(例如:智慧型手機或平板電腦),互動式健康狀態評估系統則以應用程式(Application,APP)的形式安裝於互動裝置20上。互動裝置20包括:資料輸出介面202、多模態資料輸入介面204、控制模組206、偵測裝置208及通訊模組209。其中元件202~206的功能與實施方式請參考前文,於此不贅述。資料輸出介面202、多模態資料輸入介面204及控制模組206皆通訊連接至通訊模組209,控制模組206另外通訊連接至偵測裝置208The interactive device 20 is, for example, a mobile vehicle (such as a robot) or a mobile device (such as a smartphone or a tablet) equipped with a camera device, and the interactive health assessment system is in the form of an application (APP). Mounted on the interactive device 20. The interactive device 20 includes a data output interface 202, a multi-modal data input interface 204, a control module 206, a detection device 208, and a communication module 209. For the functions and implementations of the components 202 to 206, please refer to the foregoing, and will not be repeated here. The data output interface 202, the multi-modal data input interface 204, and the control module 206 are all communicatively connected to the communication module 209, and the control module 206 is additionally communicatively connected to the detection device 208

偵測裝置208例如係攝像裝置或麥克風,用以取得一影像資料或一聲音資料,並將所取得的資料交由控制模組206判斷是否偵測到使用者。具體來說,當影像資料中具有使用者之臉部影像或該聲音資料中具有使用者之語音時,控制模組206藉由通訊模組109透過網路連線NC從對話設計資料庫102中選取一健康狀態評估問題,並透過資料輸出介面202呈現該健康狀態評估問題。The detection device 208 is, for example, a camera device or a microphone, and is used to obtain an image data or a sound data, and the obtained data is passed to the control module 206 to determine whether a user is detected. Specifically, when the image data has the user's face image or the sound data has the user's voice, the control module 206 connects the NC from the dialog design database 102 through the network through the communication module 109. A health status assessment question is selected, and the health status assessment question is presented through the data output interface 202.

基於上述二實施例,可知除了將互動式健康狀態評估系統的所有元件整合在同一硬體裝置中,亦包括如後所述的三種實施方式。Based on the above two embodiments, it can be known that in addition to integrating all the components of the interactive health state assessment system in the same hardware device, it also includes three implementation modes described below.

實施方式一:系統安裝於具視訊裝置之行動載具中,系統即可透過視訊裝置偵測到有無使用者在周遭,向使用者進行問候並透過對話或命令方式啟動系統功能。使用者操作系統功能後,系統將操作歷程記錄至雲端資料庫,並更新系統相關元件之功能,最後匯出圖表與報告提供使用者進一步學習與參考。Embodiment 1: The system is installed in a mobile vehicle with a video device, and the system can detect whether there is a user in the surroundings through the video device, greet the user, and start the system function through dialogue or command. After the user's operating system functions, the system records the operation history to the cloud database, and updates the functions of the relevant components of the system. Finally, the charts and reports are exported to provide users with further learning and reference.

實施方式二:系統安裝於行動載具中,系統可主動與使用者進行對話與互動,透過聊天對話的過程與知識庫的建置,讓系統了解使用者所缺少的觀念,並提供對應的學習清單給使用者。Embodiment 2: The system is installed in a mobile vehicle. The system can actively engage in dialogue and interaction with users. Through the process of chat and dialogue and the establishment of a knowledge base, the system can understand the concepts lacking in users and provide corresponding learning. List to users.

實施方式三:系統安裝於行動裝置中,系統可主動與使用者進行對話與互動,透過聊天對話的過程、時間、情境與生活等相關資訊的資料庫的建置,讓系統提供智慧型個人化推薦清單給使用者,以提升其生活便利性。Implementation mode 3: The system is installed in a mobile device, and the system can actively engage in dialogue and interaction with the user. Through the establishment of a database of relevant information such as the process, time, context, and life of the conversation, the system provides intelligent personalization. Recommended list for users to improve their convenience.

請參考圖2,其係繪示依據本發明一實施例的互動式健康狀態評估方法的執行流程圖。Please refer to FIG. 2, which illustrates an execution flowchart of an interactive health status assessment method according to an embodiment of the present invention.

請參考步驟S10:判斷是否偵測到使用者。詳言之,偵測裝置208取得影像資料或聲音資料;控制模組206判斷影像資料中是否具有使用者之臉部影像或聲音資料中是否具有使用者之語音。當影像資料中具有使用者之臉部影像或聲音資料中具有使用者之語音時,則移至步驟S12,否則繼續使用偵測裝置208進行偵測。而除了系統可以透過偵測裝置208主動偵測到使用者並進行問候,使用者亦可透過多模態資料輸入介面204直接下達命令給系統後啟動系統進行對話。Please refer to step S10: determine whether a user is detected. In detail, the detection device 208 obtains image data or sound data; the control module 206 determines whether the image data has a user's face image or whether the sound data has a user's voice. When the image data has the user's face image or the sound data has the user's voice, then go to step S12, otherwise continue to use the detection device 208 for detection. In addition to the system, the user can be actively detected and greeted by the detection device 208, and the user can also directly issue a command to the system through the multi-modal data input interface 204 to start the system for dialogue.

請參考步驟S12:選取並呈現一健康狀態評估問題。詳言之,系統從對話設計資料庫102中選取一健康狀態評估問題並以資料輸出介面202呈現此健康狀態評估問題。Please refer to step S12: selecting and presenting a health assessment question. In detail, the system selects a health assessment question from the dialogue design database 102 and presents the health assessment question through the data output interface 202.

請參考步驟S14:接收答覆資訊。詳言之,系統透過多模態資料輸入介面204接收使用者的語音、影像、或生理量測訊號等答覆資訊。例如透過感測模組接收聲音資料;透過觸控式螢幕接收觸發訊號;或透過通訊模組接收藍芽輸入訊號或無線輸入訊號。Please refer to step S14: receiving reply information. In detail, the system receives response information such as a user's voice, image, or physiological measurement signal through the multi-modal data input interface 204. For example, receiving sound data through a sensing module; receiving a trigger signal through a touch screen; or receiving a Bluetooth input signal or a wireless input signal through a communication module.

請參考步驟S20:判斷答覆資訊類型。詳言之,系統透過辨識模組104判斷答覆資訊屬於數值類型或是文字類型。當答覆資訊屬於數值類型時,請參考步驟S22,健康狀態評估模組108根據答覆資訊及預存的數值規則產生第一評估結果。另一方面,當答覆資訊屬於文字類型時,請參考步驟S24~S26,語意理解模組106從答覆資訊中擷取關鍵字,然後健康狀態評估模組108根據關鍵字產生第二評估結果。健康狀態評估模組108更將上述二評估結果中的至少一者儲存於一暫存空間。Please refer to step S20: determine the type of response information. In detail, the system determines whether the response information is a numeric type or a text type through the recognition module 104. When the response information is of a numerical type, please refer to step S22. The health status evaluation module 108 generates a first evaluation result according to the response information and a pre-stored numerical rule. On the other hand, when the response information is of a text type, please refer to steps S24 to S26. The semantic understanding module 106 extracts keywords from the response information, and then the health evaluation module 108 generates a second evaluation result according to the keywords. The health evaluation module 108 further stores at least one of the two evaluation results in a temporary storage space.

請參考步驟S30,判斷是否收到互動結束訊號。詳言之,當未收到互動結束訊號時,從健康狀態評估問題的續接項目中選擇另一健康狀態評估問題,並回到步驟S12。判斷是否收到該互動結束訊號包括下列方式:接獲代表結束互動之一觸發訊號;或健康狀態評估問題之續接項目對應零個健康狀態評估問題。Please refer to step S30 to determine whether an interaction end signal is received. In detail, when the interaction end signal is not received, another health state assessment question is selected from the continuation items of the health state assessment question, and the process returns to step S12. Judging whether the interaction end signal is received includes the following methods: receiving one of the trigger signals to end the interaction; or the continuation item of the health status assessment question corresponds to zero health status assessment questions.

反過來說,當系統已收到互動結束訊號時,健康狀態評估模組108根據暫存空間的資料輸出評估報告,並透過資料輸出介面202呈現此評估報告,如步驟S32所示。另外,在輸出評估報告之前可更包括根據使用者之臉部影像或使用者之語音至一使用者資料庫中尋找對應使用者之一儲存空間;再將評估報告儲存於對應當前使用者的儲存空間。Conversely, when the system has received the end-of-interaction signal, the health evaluation module 108 outputs an evaluation report based on the data in the temporary storage space, and presents the evaluation report through the data output interface 202, as shown in step S32. In addition, before outputting the evaluation report, it may further include searching for a storage space of the corresponding user in a user database according to the user's face image or the user's voice; and then storing the evaluation report in the storage corresponding to the current user. space.

綜上所述,本發明所述的互動式健康狀態評估系統及其方法可導入到居家機器人或APP,應用於居家,達到舒緩高齡化社會與長照上的的陪伴需求。此外也可應用於醫療照護場域,代替醫護人員進行重複性高的衛生教育,讓醫護人員可以專注於病患的個別照護,以提升並優化醫療品質。In summary, the interactive health status assessment system and method described in the present invention can be imported into a home robot or APP and applied to homes to meet the needs of accompaniment in an aging society and long-term photos. In addition, it can also be applied in the field of medical care, instead of medical staff to provide highly repetitive health education, so that medical staff can focus on the individual care of patients to improve and optimize the quality of medical care.

雖然本發明以前述之實施例揭露如上,然其並非用以限定本發明。在不脫離本發明之精神和範圍內,所為之更動與潤飾,均屬本發明之專利保護範圍。關於本發明所界定之保護範圍請參考所附之申請專利範圍。Although the present invention is disclosed in the foregoing embodiments, it is not intended to limit the present invention. Changes and modifications made without departing from the spirit and scope of the present invention belong to the patent protection scope of the present invention. For the protection scope defined by the present invention, please refer to the attached patent application scope.

10‧‧‧評估裝置10‧‧‧ Evaluation Device

102‧‧‧對話設計資料庫 102‧‧‧Dialogue Design Database

104‧‧‧辨識模組 104‧‧‧Identification Module

106‧‧‧語意理解模組 106‧‧‧ Semantic Understanding Module

108‧‧‧健康狀態評估模組 108‧‧‧ Health Assessment Module

109‧‧‧通訊模組 109‧‧‧Communication Module

NC‧‧‧網路連線 NC‧‧‧Network connection

20‧‧‧互動裝置 20‧‧‧ Interactive Device

202‧‧‧資料輸出介面 202‧‧‧Data output interface

204‧‧‧多模態資料輸入介面 204‧‧‧Multi-modal data input interface

206‧‧‧控制模組 206‧‧‧Control Module

208‧‧‧偵測裝置 208‧‧‧detection device

209‧‧‧通訊模組 209‧‧‧communication module

S10~S32‧‧‧步驟 S10 ~ S32‧‧‧step

圖1A係依據本發明一實施例的互動式健康評估系統所繪示的架構圖。 圖1B係依據本發明另一實施例的互動式健康評估系統的所繪示的架構圖。 圖2係依據本發明一實施例的互動式健康評估方法所繪示的流程圖。FIG. 1A is a structural diagram of an interactive health assessment system according to an embodiment of the present invention. FIG. 1B is a diagram illustrating a structure of an interactive health assessment system according to another embodiment of the present invention. FIG. 2 is a flowchart illustrating an interactive health assessment method according to an embodiment of the invention.

Claims (11)

一種互動式健康狀態評估方法,包括:從一對話設計資料庫中選取一健康狀態評估問題並以一資料輸出介面呈現該健康狀態評估問題,其中該對話設計資料庫包括複數個健康狀態評估問題,每一該些健康狀態評估問題具有一續接項目,該續接項目對應至該對話設計資料庫中的零個或至少另一個健康狀態評估問題;在該資料輸出介面呈現該健康狀態評估問題之後,以一多模態資料輸入介面接收一答覆資訊;以一辨識程序判斷該答覆資訊之類型;當該答覆資訊屬於數值類型時,以一健康狀態評估程序根據該答覆資訊及一數值規則產生一第一評估結果及儲存該第一評估結果於一暫存空間;當該答覆資訊屬於文字類型時,以一語意理解程序從該答覆資訊中擷取一關鍵字,以該健康狀態評估程序根據該關鍵字產生一第二評估結果及儲存該第二評估結果於該暫存空間;以及在產生該第一評估結果或該第二評估結果之後,判斷是否收到一互動結束訊號;當已收到該互動結束訊號時,以該健康狀態評估程序根據該暫存空間中的資料輸出一評估報告;當未收到該互動結束訊號時,選擇另一健康狀態評估問題,其中該另一健康狀態評估問題係選擇性地從該續接項目中被選擇。An interactive health state assessment method includes: selecting a health state assessment question from a dialogue design database and presenting the health state assessment question through a data output interface, wherein the dialogue design database includes a plurality of health state assessment questions, Each of the health status assessment questions has a continuation item corresponding to zero or at least one other health status assessment question in the dialogue design database; after the health status assessment question is presented in the data output interface To receive a reply information through a multi-modal data input interface; determine the type of the reply information by an identification process; when the reply information is of a numerical type, a health state assessment process is used to generate a response based on the reply information and a numerical rule The first evaluation result and the first evaluation result are stored in a temporary storage space; when the response information is a text type, a keyword is extracted from the response information by a semantic understanding process, and the health status evaluation process is used according to the The keyword generates a second evaluation result and stores the second evaluation result in the temporary Space; and after generating the first evaluation result or the second evaluation result, determine whether an interaction end signal has been received; when the interaction end signal has been received, use the health status evaluation procedure according to the The data outputs an evaluation report; when the interaction end signal is not received, another health status evaluation question is selected, wherein the another health status evaluation question is selectively selected from the continuation item. 如請求項1所述的互動式健康狀態評估方法,其中每一該些健康狀態評估問題更具有一應答關鍵詞彙對應於該續接項目,且選擇該另一健康狀態評估問題更包括:當該關鍵字符合該應答關鍵詞彙時,選擇該應答關鍵詞彙對應之該續接項目。The interactive health status assessment method according to claim 1, wherein each of the health status assessment questions further has a response keyword corresponding to the continuation item, and selecting the other health status assessment question further includes: when the When the keywords match the response keyword pool, the continuation item corresponding to the response keyword pool is selected. 如請求項1所述的互動式健康狀態評估方法,其中每一該些健康狀態評估問題更具有一觸發關鍵詞彙,且選擇該另一健康狀態評估問題更包括:從該些健康狀態評估問題之該觸發關鍵詞彙中尋找與該關鍵字相符者作為該另一健康狀態評估問題。The interactive health status assessment method according to claim 1, wherein each of the health status assessment questions further has a trigger keyword, and selecting the other health status assessment question further includes: from among the health status assessment questions The triggering keyword pool looks for a match with the keyword as the other health status evaluation question. 如請求項1所述的互動式健康狀態評估方法,其中在從該對話設計資料庫選取該健康狀態評估問題之前,更包括:以一偵測裝置取得一影像資料或一聲音資料;以及判斷該影像資料中是否具有一使用者之臉部影像或該聲音資料中是否具有該使用者之語音;當該影像資料中具有該使用者之臉部影像或該聲音資料中具有該使用者之語音時,始從該對話設計資料庫選取該健康狀態評估問題。The interactive health assessment method according to claim 1, wherein before selecting the health assessment question from the dialog design database, the method further comprises: obtaining an image data or a sound data by a detection device; and determining the Whether the image data has a user's face image or the sound data has the user's voice; when the image data has the user's face image or the sound data has the user's voice , Select the health assessment question from the dialog design database. 如請求項1所述的互動式健康狀態評估方法,其中判斷是否收到該互動結束訊號包括下列方式:接獲代表結束互動之一觸發訊號;或該健康狀態評估問題之該續接項目對應零個健康狀態評估問題。The interactive health status assessment method according to claim 1, wherein determining whether the interaction end signal is received includes the following methods: receiving a trigger signal indicating that one of the end interactions is received; or the continuation item corresponding to the health status evaluation question corresponds to zero Health assessment questions. 如請求項4所述的互動式健康狀態評估方法,其中在輸出該評估報告之前,更包括:根據該使用者之臉部影像或該使用者之語音至一使用者資料庫中尋找對應該使用者之一儲存空間;以及儲存該評估報告於該儲存空間。The interactive health state assessment method according to claim 4, before outputting the assessment report, further comprising: searching for a corresponding use according to the user's face image or the user's voice in a user database. One of the storage spaces; and the evaluation report in the storage space. 一種互動式健康狀態評估系統,包括:一對話設計資料庫,包括複數個健康狀態評估問題,每一該些健康狀態評估問題具有一續接項目,該續接項目對應至該對話設計資料庫中的零個或至少另一個健康狀態評估問題;一資料輸出介面,通訊連接該對話設計資料庫,該資料輸出介面用以呈現該健康狀態評估問題;一多模態資料輸入介面,用以接收一答覆資訊;一辨識模組,通訊連接該多模態資料輸入介面,該辨識模組用以判斷該答覆資訊屬於文字類型或數值類型;一語意理解模組,通訊連接該辨識模組,該語意理解模組用以從屬於文字類型的該答覆資訊中擷取一關鍵字;一健康狀態評估模組,通訊連接該辨識模組及該語意理解模組,該健康狀態評估模組用以從屬於數值狀態的該答覆資訊及一數值規則產生一第一評估結果、根據該關鍵字產生一第二評估結果、儲存該第一及該第二評估結果至一暫存空間及根據該暫存空間之資料輸出一評估報告;以及一控制模組,通訊連接該對話設計資料庫、該多模態資料輸入介面及該健康狀態評估模組,該控制模組用以在收到一互動完成訊號時通知該健康狀態評估模組輸出該評估報告,及在未收到該互動完成訊號時選擇另一健康狀態評估問題,其中該另一健康狀態評估問題係選擇性地從該續接項目中被選擇。An interactive health status assessment system includes a dialogue design database including a plurality of health status assessment questions, and each of these health status assessment questions has a continuation item, and the continuation item corresponds to the dialogue design database Zero or at least one health status assessment question; a data output interface that communicates with the dialogue design database, the data output interface is used to present the health status assessment problem; a multi-modal data input interface is used to receive a Response information; a recognition module that communicates with the multi-modal data input interface; the recognition module is used to determine whether the response information is a text type or a numerical value; a semantic understanding module that communicates with the recognition module and communicates the semantic meaning The comprehension module is used to extract a keyword from the reply information belonging to the text type; a health status evaluation module, which communicates with the recognition module and the semantic understanding module, and the health status evaluation module is used to belong to The response information of the numerical status and a numerical rule generate a first evaluation result, and a second evaluation according to the keyword Results, storing the first and the second evaluation results in a temporary storage space and outputting an evaluation report based on the data in the temporary storage space; and a control module, which communicates with the dialogue design database and the multi-modal data input Interface and the health status evaluation module, the control module is used to notify the health status evaluation module to output the evaluation report when receiving an interaction completion signal, and select another health status when the interaction completion signal is not received An assessment question, wherein the other health assessment question is selectively selected from the continuation item. 如請求項7所述的互動式健康狀態評估系統,其中每一該些健康狀態評估問題更具有一應答關鍵詞彙對應於該續接項目,該控制模組更用以判斷該關鍵字是否符合該應答關鍵詞彙,且在關鍵字符合該應答關鍵詞彙時,選擇該應答關鍵詞彙對應之該續接項目。The interactive health status evaluation system according to claim 7, wherein each of the health status evaluation questions further has a response keyword pool corresponding to the continuation item, and the control module is further configured to determine whether the keyword matches the keyword Response keyword pool, and when the keywords match the response keyword pool, select the continuation item corresponding to the response keyword pool. 如請求項7所述的互動式健康狀態評估系統,其中每一該些健康狀態評估問題更具有一觸發關鍵詞彙,該控制模組更用以從該些健康狀態評估問題中之該觸發關鍵詞彙中尋找與該關鍵字相符者作為該另一健康狀態評估問題。The interactive health status assessment system according to claim 7, wherein each of the health status assessment questions further has a trigger keyword sink, and the control module is further configured to extract the trigger keyword sink from the health status assessment questions. The search for a match with the keyword is used as the other health status evaluation question. 如請求項7所述的互動式健康狀態評估系統,更包括:一偵測裝置,通訊連接至該控制模組,該偵測裝置用以取得一影像資料或一聲音資料;該控制模組更通訊連接至該資料輸出介面,且更用以判斷該影像資料中是否具有一使用者之臉部影像或該聲音資料中是否具有該使用者之語音,當該影像資料中具有該使用者之臉部影像或該聲音資料中具有該使用者之語音時,該控制模組更包括從該對話設計資料庫中選取該健康狀態評估問題並以該資料輸出介面呈現該健康狀態評估問題。The interactive health assessment system according to claim 7, further comprising: a detection device communicatively connected to the control module, the detection device is used to obtain an image data or a sound data; the control module is further The communication is connected to the data output interface, and is further used to determine whether the image data has a user's face image or the sound data has the user's voice. When the image data has the user's face When the user's voice is included in the video or audio data, the control module further includes selecting the health status evaluation question from the dialog design database and presenting the health status evaluation question through the data output interface. 如請求項8所述的互動式健康狀態評估系統,更包括:一使用者資料庫,通訊連接該健康狀態評估模組,該使用者資料庫用以根據該使用者之臉部影像或該使用者之語音尋找對應該使用者之一儲存空間,及儲存該評估報告於該儲存空間。The interactive health status assessment system according to claim 8, further comprising: a user database, which is communicatively connected to the health status assessment module, and the user database is used for the user's face image or the use The user's voice searches for a storage space corresponding to one of the users, and stores the evaluation report in the storage space.
TW107143071A 2018-11-30 2018-11-30 System and method of interactive health assessment TWI659429B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW107143071A TWI659429B (en) 2018-11-30 2018-11-30 System and method of interactive health assessment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW107143071A TWI659429B (en) 2018-11-30 2018-11-30 System and method of interactive health assessment

Publications (2)

Publication Number Publication Date
TWI659429B true TWI659429B (en) 2019-05-11
TW202022891A TW202022891A (en) 2020-06-16

Family

ID=67348160

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107143071A TWI659429B (en) 2018-11-30 2018-11-30 System and method of interactive health assessment

Country Status (1)

Country Link
TW (1) TWI659429B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI735899B (en) * 2019-06-28 2021-08-11 國立臺北商業大學 Communication system and method with status judgment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103229162A (en) * 2010-09-28 2013-07-31 国际商业机器公司 Providing answers to questions using logical synthesis of candidate answers
CN107610774A (en) * 2017-10-25 2018-01-19 医渡云(北京)技术有限公司 Intelligent way of inquisition and device, storage medium, electronic equipment
CN108491486A (en) * 2018-03-14 2018-09-04 东软集团股份有限公司 Simulate patient's interrogation dialogue method, device, terminal device and storage medium
TWM568417U (en) * 2018-04-27 2018-10-11 中臺科技大學 Cognitive function evaluation device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103229162A (en) * 2010-09-28 2013-07-31 国际商业机器公司 Providing answers to questions using logical synthesis of candidate answers
CN107610774A (en) * 2017-10-25 2018-01-19 医渡云(北京)技术有限公司 Intelligent way of inquisition and device, storage medium, electronic equipment
CN108491486A (en) * 2018-03-14 2018-09-04 东软集团股份有限公司 Simulate patient's interrogation dialogue method, device, terminal device and storage medium
TWM568417U (en) * 2018-04-27 2018-10-11 中臺科技大學 Cognitive function evaluation device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI735899B (en) * 2019-06-28 2021-08-11 國立臺北商業大學 Communication system and method with status judgment

Also Published As

Publication number Publication date
TW202022891A (en) 2020-06-16

Similar Documents

Publication Publication Date Title
CN103561652B (en) Method and system for assisting patients
JP7285589B2 (en) INTERACTIVE HEALTH CONDITION EVALUATION METHOD AND SYSTEM THEREOF
WO2019111618A1 (en) Patient status determination device, patient status determination system, patient status determination method, and patient status determination program recording medium
US20180047030A1 (en) Customer service device, customer service method, and customer service system
US10978209B2 (en) Method of an interactive health status assessment and system thereof
US20150331665A1 (en) Information provision method using voice recognition function and control method for device
US9934426B2 (en) System and method for inspecting emotion recognition capability using multisensory information, and system and method for training emotion recognition using multisensory information
US10657960B2 (en) Interactive system, terminal, method of controlling dialog, and program for causing computer to function as interactive system
CN107910073A (en) A kind of emergency treatment previewing triage method and device
US20170084271A1 (en) Voice processing apparatus and voice processing method
KR20210008089A (en) Dynamic and/or context specific hotwords for invoking automated assistants
KR102466438B1 (en) Cognitive function assessment system and method of assessing cognitive funtion
KR20210137118A (en) Systems and methods for context-rich attentional memory networks with global and local encoding for dialogue break detection
US11763690B2 (en) Electronic apparatus and controlling method thereof
CN109599127A (en) Information processing method, information processing unit and message handling program
JP2021058573A (en) Cognitive function prediction device, cognitive function prediction method, program and system
TWI659429B (en) System and method of interactive health assessment
US20210406736A1 (en) System and method of content recommendation
KR101567154B1 (en) Method for processing dialogue based on multiple user and apparatus for performing the same
JP2010231084A (en) Learning support system, learning support method, and computer program
CN113782200A (en) Psychological risk screening and determining method and device, computer equipment and storage medium
US20230207073A1 (en) Program, information processing device, and information processing method
JP2016163166A (en) Communication terminal, interview system, display method, and program
TW202022647A (en) Controlling system and controlling method for social network
KR20200079054A (en) Robot and method for controlling thereof