TW202340913A - Virtual reality system for muscle strength scale teaching - Google Patents

Virtual reality system for muscle strength scale teaching Download PDF

Info

Publication number
TW202340913A
TW202340913A TW111112719A TW111112719A TW202340913A TW 202340913 A TW202340913 A TW 202340913A TW 111112719 A TW111112719 A TW 111112719A TW 111112719 A TW111112719 A TW 111112719A TW 202340913 A TW202340913 A TW 202340913A
Authority
TW
Taiwan
Prior art keywords
virtual
unit
data
rehabilitation
muscle strength
Prior art date
Application number
TW111112719A
Other languages
Chinese (zh)
Other versions
TWI799223B (en
Inventor
吳柏蒼
Original Assignee
國立臺中科技大學
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 國立臺中科技大學 filed Critical 國立臺中科技大學
Priority to TW111112719A priority Critical patent/TWI799223B/en
Application granted granted Critical
Publication of TWI799223B publication Critical patent/TWI799223B/en
Publication of TW202340913A publication Critical patent/TW202340913A/en

Links

Images

Abstract

The present invention relates to a virtual reality system for muscle strength scale teaching, which enables users to experience the scene in person through the virtual reality, and improves the overall learning effect and the purpose of practical application through continuous simulation exercises.

Description

肌力評估教學虛擬實境系統Muscle strength assessment teaching virtual reality system

本發明係與虛擬實境系統有關,特別是有關於一種肌力評估教學虛擬實境系統。The present invention relates to a virtual reality system, and in particular to a muscle strength assessment and teaching virtual reality system.

在求學過程中,學生透過各種類型的課程教學,可以學到各式各樣的知識,且可以了解產業之實際工作內容,進而找尋到自己的喜好及未來目標。In the process of studying, students can learn a variety of knowledge through various types of course teaching, and can understand the actual work content of the industry, and then find their own preferences and future goals.

但在課堂上了解行業內容、實施原理、工作步驟並不代表能夠真正在現實生活中活用及實施。理論強實務不佳僅會淪落到紙上談兵,而實務強但缺乏理論則會侷限於現有環境及事務,無法進一步延伸精進,因此,理論與實務二者必須要相輔相成不可偏廢。However, understanding the industry content, implementation principles, and work steps in the classroom does not mean that it can be truly used and implemented in real life. Strong theory but poor practice will only result in talk on paper, while strong practice but lack of theory will be limited to the current environment and affairs, unable to further extend and improve. Therefore, theory and practice must complement each other and cannot be neglected.

科技大學的主要理想目標就是要兼顧理論與實務,讓學生能夠將課堂上學的知識、作法、步驟能夠確實地活用在生活、工作上,達到學以致用之目的。舉例來說,肌力教學訓練課程,雖在課堂上透過口語、紙本、影片教學或是師生模擬應對,但實際在工作場合時所遇到的人事物更為多變,且顧客大都是不熟悉的,而如何讓學生能夠確實地將課堂中所學應用於職場、生活中,達到技職教育學用合一的目的是目前亟需思考的問題。The main ideal goal of the University of Science and Technology is to balance theory and practice, so that students can truly apply the knowledge, practices, and steps learned in the classroom to life and work, so as to achieve the purpose of applying what they have learned. For example, although the muscle strength teaching and training course uses oral language, paper, video teaching or teacher-student simulation in the classroom, the people and things encountered in the actual workplace are more varied, and most of the customers are For those who are not familiar with it, how to enable students to truly apply what they learn in the classroom to the workplace and life, and to achieve the purpose of integrating learning and application in technical and vocational education is an issue that needs to be considered urgently.

因此,有必要提供一種新穎且具有進步性之肌力評估教學虛擬實境系統,以解決上述之問題。Therefore, it is necessary to provide a novel and progressive virtual reality system for muscle strength assessment teaching to solve the above problems.

本發明之主要目的在於提供一種肌力評估教學虛擬實境系統,可透過虛擬實境(Virtual Reality)的視覺臨場效果,讓學習者能夠獲得親臨現場的體驗,透過不斷的模擬練習,提高學習意願,達到提升學習成效的目的。The main purpose of the present invention is to provide a virtual reality system for muscle strength assessment teaching, which can enable learners to gain the experience of being at the scene through the visual presence effect of virtual reality, and improve learning willingness through continuous simulation exercises. , to achieve the purpose of improving learning effectiveness.

為達成上述目的,本發明提供一種肌力評估教學虛擬實境系統,包括:一系統建構單元及一虛擬實境單元。該系統建構單元包含有一虛擬受測者設定模組、一虛擬環境資料、一對話腳本、複數肌肉群圖形資料、一評估表資料及一訓練流程,該虛擬受測者設定模組包含有複數待檢測肌肉群項目,該複數待檢測肌肉群項目分別預設有相對應的肌力等級,該對話腳本包含有複數回應句及複數關鍵字,該複數肌肉群圖形資料分別對應該複數待檢測肌肉群項目,該訓練流程包含有一檢測部位功能選擇步驟、一檢測圖形選擇步驟、一檢測姿勢選擇步驟、一評估步驟,該檢測部位功能選擇步驟用以選擇預測試之該肌肉群項目,該檢測圖形選擇步驟為選擇與待檢測該肌肉群項目相符合的圖片,該檢測姿勢選擇步驟用以選擇躺姿或坐姿,該評估步驟為分析待檢測該肌肉群項目之肌力狀態;該虛擬實境單元包含有一手部感應器、一處理單元、一顯示單元及一語音辨識單元,該手部感應器供配戴於使用者之手部以偵測手部動作及位置,進而得到一即時動作資料,該處理單元通訊連接該手部感應器以獲取該即時動作資料並將運算後之訊息傳遞予該顯示單元以同步顯示出一虛擬手部,該處理單元通訊連接該系統建構單元並將設定後該虛擬受測者設定模組、該虛擬環境資料、該複數肌肉群圖形資料、該評估表資料遞予該顯示單元以顯示出虛擬受測者、一虛擬環境、複數肌肉群圖、一虛擬肌力評估表,該虛擬受測者、該虛擬環境、該複數肌肉群圖、該虛擬肌力評估表定義為一互動單元,該處理單元透過該虛擬手部與該互動單元之相對位置及動作判斷出一操作狀態,進而該處理單元令該互動單元產生與該操作狀態相匹配之變化並顯示於該顯示單元,該語音辨識單元通訊連接該處理單元,該語音辨識單元傳遞一即時音訊資料予該處理單元,該處理單元比對該即時音訊資料及該複數關鍵字,當該處理單元判斷出該即時音訊資料包含有至少一該關鍵字時,該處理單元令該虛擬受測者依據該虛擬受測者設定模組之設定狀態回應出與至少一該關鍵字相匹配之至少一該回應句或做出與至少一該關鍵字相匹配之動作變化。In order to achieve the above object, the present invention provides a muscle strength assessment teaching virtual reality system, which includes: a system construction unit and a virtual reality unit. The system building unit includes a virtual subject setting module, a virtual environment data, a dialogue script, a plurality of muscle group graphic data, an evaluation form data and a training process. The virtual subject setting module includes a plurality of subjects. Muscle group detection items, the plurality of muscle group items to be detected are respectively preset with corresponding muscle strength levels, the dialogue script includes plural response sentences and plural keywords, and the plurality of muscle group graphic data respectively correspond to the plurality of muscle groups to be detected. project, the training process includes a detection part function selection step, a detection pattern selection step, a detection posture selection step, and an evaluation step. The detection part function selection step is used to select the muscle group item for pre-test, and the detection pattern selection step The step is to select a picture that is consistent with the muscle group item to be detected. The detection posture selection step is used to select a lying posture or a sitting posture. The evaluation step is to analyze the muscle strength status of the muscle group item to be detected; the virtual reality unit includes There is a hand sensor, a processing unit, a display unit and a voice recognition unit. The hand sensor is worn on the user's hand to detect hand movements and positions, and thereby obtain real-time movement data. The processing unit communicates with the hand sensor to obtain the real-time motion data and transmits the calculated information to the display unit to simultaneously display a virtual hand. The processing unit communicates with the system construction unit and sets the virtual hand. The subject setting module, the virtual environment data, the plurality of muscle group graphic data, and the evaluation table data are delivered to the display unit to display the virtual subject, a virtual environment, multiple muscle group graphics, and a virtual muscle strength assessment. Table, the virtual subject, the virtual environment, the multiple muscle group map, and the virtual muscle strength evaluation table are defined as an interactive unit, and the processing unit determines an interactive unit through the relative position and movement of the virtual hand and the interactive unit. The operating state, and then the processing unit causes the interactive unit to produce changes that match the operating state and display them on the display unit. The voice recognition unit is connected to the processing unit through communication, and the voice recognition unit transmits real-time audio data to the processing unit. , the processing unit compares the real-time audio data with the plurality of keywords. When the processing unit determines that the real-time audio data contains at least one of the keywords, the processing unit causes the virtual subject to The setting state of the setting module responds with at least one response sentence that matches at least one of the keywords or makes an action change that matches at least one of the keywords.

以下僅以實施例說明本發明可能之實施態樣,然並非用以限制本發明所欲保護之範疇,文中所提之名詞前冠以的「一」或「至少一」並非對數量進行限制,依據需求亦可為「複數」個,此數量上之變化亦為所欲保護之範圍,合先敘明。The following examples are only used to illustrate possible implementations of the present invention, but they are not intended to limit the scope of protection of the present invention. The "one" or "at least one" before the nouns mentioned in the article do not limit the number. It can also be "plural" according to the requirements. This change in quantity is also the scope of the desired protection, which will be explained first.

請參考圖1至圖12,其顯示本發明之一實施例,本發明之肌力評估教學虛擬實境系統包括:一系統建構單元1及一虛擬實境單元4。Please refer to Figures 1 to 12, which show an embodiment of the present invention. The muscle strength assessment teaching virtual reality system of the present invention includes: a system construction unit 1 and a virtual reality unit 4.

該系統建構單元1包含有一虛擬受測者設定模組11、一虛擬環境資料12、一對話腳本13、複數肌肉群圖形資料14、一評估表資料15及一訓練流程2。該虛擬受測者設定模組11包含有複數待檢測肌肉群項目111,如髖關節屈曲與伸展、膝關節伸展、踝關節背屈,該複數待檢測肌肉群項目111分別預設有相對應的肌力等級,肌力等級分成0、1、2、3、4、5級其代表意涵為無力、微縮力道、不佳、尚可、良好及正常。該對話腳本13包含有複數回應句及複數關鍵字,該複數肌肉群圖形資料14分別對應該複數待檢測肌肉群項目111。The system construction unit 1 includes a virtual subject setting module 11, a virtual environment data 12, a dialogue script 13, multiple muscle group graphic data 14, an evaluation table data 15 and a training process 2. The virtual subject setting module 11 includes a plurality of muscle group items 111 to be detected, such as hip joint flexion and extension, knee joint extension, and ankle joint dorsiflexion. The plurality of muscle group items 111 to be detected are respectively preset with corresponding Muscle strength grade, muscle strength grade is divided into levels 0, 1, 2, 3, 4, and 5. Their representative meanings are weak, minimal strength, poor, fair, good, and normal. The dialogue script 13 includes plural response sentences and plural keywords, and the plural muscle group graphic data 14 respectively correspond to the plural muscle group items 111 to be detected.

該訓練流程2包含有一檢測部位功能選擇步驟21、一檢測圖形選擇步驟22、一檢測姿勢選擇步驟23、一評估步驟24,該檢測部位功能選擇步驟21用以選擇預測試之該肌肉群項目,該檢測圖形選擇步驟22為選擇與待檢測該肌肉群項目相符合的圖片,該檢測姿勢選擇步驟23用以選擇躺姿或坐姿,該評估步驟24為分析待檢測該肌肉群項目之肌力狀態(級數),透過該訓練流程2可以讓使用者學習到正確的肌力檢測順序。The training process 2 includes a detection part function selection step 21, a detection pattern selection step 22, a detection posture selection step 23, and an evaluation step 24. The detection part function selection step 21 is used to select the muscle group item for pre-test. The detection pattern selection step 22 is to select a picture consistent with the muscle group item to be detected. The detection posture selection step 23 is to select a lying posture or a sitting posture. The evaluation step 24 is to analyze the muscle strength status of the muscle group item to be detected. (Grade), through this training process 2, users can learn the correct sequence of muscle strength testing.

該虛擬實境單元4包含有一手部感應器3、一處理單元41、一顯示單元42及一語音辨識單元43。The virtual reality unit 4 includes a hand sensor 3 , a processing unit 41 , a display unit 42 and a voice recognition unit 43 .

詳細地說,該手部感應器3供配戴於使用者之手部以偵測手部動作及位置,進而得到一即時動作資料,該顯示單元42係為頭戴式裝置供配戴於使用者之頭部以提供虛擬影像,該處理單元41通訊連接該手部感應器3以獲取該即時動作資料並將運算後之訊息傳遞予該顯示單元42以同步顯示出一虛擬手部5,該處理單元41通訊連接該系統建構單元1並將設定後該虛擬受測者設定模組11、該虛擬環境資料12、該複數肌肉群圖形資料14、該評估表資料15遞予該顯示單元42以顯示出一虛擬受測者51、一虛擬環境52、複數肌肉群圖53、一虛擬肌力評估表54,該虛擬受測者51、該虛擬環境52、該複數肌肉群圖53、該虛擬肌力評估表54定義為一互動單元,該處理單元41透過該虛擬手部5與該互動單元之相對位置及動作判斷出一操作狀態,進而該處理單元41令該互動單元產生與該操作狀態相匹配之變化並顯示於該顯示單元42,以達到實境與虛擬互動之目的。Specifically, the hand sensor 3 is worn on the user's hand to detect hand movements and positions, and thereby obtains real-time movement data. The display unit 42 is a head-mounted device for use. The person's head is provided with a virtual image. The processing unit 41 communicates with the hand sensor 3 to obtain the real-time motion data and transmits the calculated information to the display unit 42 to simultaneously display a virtual hand 5. The processing unit 41 communicates with the system construction unit 1 and delivers the set virtual subject setting module 11, the virtual environment data 12, the plurality of muscle group graphic data 14, and the evaluation table data 15 to the display unit 42. A virtual subject 51, a virtual environment 52, multiple muscle group maps 53, and a virtual muscle strength evaluation table 54 are displayed. The virtual subject 51, the virtual environment 52, the multiple muscle group maps 53, and the virtual muscle strength evaluation table 54 are displayed. The force evaluation table 54 is defined as an interactive unit. The processing unit 41 determines an operating state through the relative position and movement of the virtual hand 5 and the interactive unit, and then the processing unit 41 causes the interactive unit to generate a signal corresponding to the operating state. The matching changes are displayed on the display unit 42 to achieve the purpose of real-world and virtual interaction.

更詳細地說,該語音辨識單元43通訊連接該處理單元41,該語音辨識單元43傳遞一即時音訊資料予該處理單元41,該處理單元41比對該即時音訊資料及該複數關鍵字,當該處理單元41判斷出該即時音訊資料包含有至少一該關鍵字時,該處理單元41令該虛擬受測者51依據該虛擬受測者設定模組11之設定狀態回應出與至少一該關鍵字相匹配之至少一該回應句或做出與至少一該關鍵字相匹配之動作變化。舉例來說,該關鍵字為「抬腳」,當使用者口述的該即時音訊資料中有抬腳時,若腿部肌力等級設定為0時,該虛擬受測者51之該回應句可為:「抬不起來,腳沒力」,若腿部肌力等級設定為5時,該虛擬受測者51之動作可直接將腳抬起。In more detail, the voice recognition unit 43 is connected to the processing unit 41 through communication. The voice recognition unit 43 transmits real-time audio data to the processing unit 41. The processing unit 41 compares the real-time audio data with the plurality of keywords. When When the processing unit 41 determines that the real-time audio data contains at least one of the keywords, the processing unit 41 causes the virtual subject 51 to respond with at least one of the keywords according to the setting status of the virtual subject setting module 11 At least one response sentence that matches a word or an action change that matches at least one keyword is made. For example, the keyword is "lifting feet". When the real-time audio data spoken by the user includes raising feet, if the leg muscle strength level is set to 0, the response sentence of the virtual subject 51 can be It is: "Can't lift, the feet are weak." If the leg muscle strength level is set to 5, the virtual subject 51 can directly lift the feet.

較佳地,該顯示單元42另會將該虛擬受測者51的至少一該回應句以字幕方式顯示出來,以便使用者能透過目視、耳聽等不同方式來接收訊息。Preferably, the display unit 42 will also display at least one of the response sentences of the virtual subject 51 in the form of subtitles, so that the user can receive the message through different methods such as visual inspection and auditory listening.

另一較佳地,該虛擬實境單元4另包含有一撥音單元44,該撥音單元44通訊連接該處理單元41以撥放至少一該回應句,以讓使用者與該虛擬受測者51之間產生互動對話感。Preferably, the virtual reality unit 4 further includes a tone dialing unit 44, which is communicatively connected to the processing unit 41 to play at least one of the response sentences, so that the user can communicate with the virtual subject 51. Create a sense of interactive dialogue.

於本實施例中,該複數待檢測肌肉群項目111之肌力等級可進行調整改變,進而於該顯示單元42中該虛擬受測者51會有不同的動作表現,因此,此套系統若用於學校時,設定值可交由老師來進行設定,以讓學習者透過該虛擬受測者51之肌力的不同動作來判斷評估出肌力等級。In this embodiment, the muscle strength levels of the plurality of muscle group items 111 to be detected can be adjusted and changed, so that the virtual subject 51 will have different action performances in the display unit 42. Therefore, if this system is used When in school, the setting value can be set by the teacher, so that the learner can judge and evaluate the muscle strength level through different actions of the muscle strength of the virtual subject 51 .

該訓練流程2另包含有一復健安排步驟25,該系統建構單元1另包含有複數復健動作資料19,該復健安排步驟25為依據檢測後該肌肉群項目之肌力等級來選擇相對的該復健動作資料19。更進一步地說,該系統建構單元1另包含有一復健表資料18,該顯示單元42中依據該複數復健動作資料19及該復健表資料18顯示出複數復健動作圖片58及一虛擬復健表57,透過該虛擬手部5可分別拉動至少一該復健動作圖片58至該虛擬復健表57之至少一安排區571,如同連連看般的操作,不僅操作便利直觀,更有助於讓使用者學習到評估肌力後應對應何種復健行為,如此才算是完成一個完整的肌力評估程序。The training process 2 also includes a rehabilitation arrangement step 25. The system construction unit 1 also includes a plurality of rehabilitation action data 19. The rehabilitation arrangement step 25 is to select the corresponding muscle group according to the muscle strength level of the muscle group after testing. The rehabilitation action information19. Furthermore, the system construction unit 1 further includes a rehabilitation table data 18, and the display unit 42 displays a plurality of rehabilitation action pictures 58 and a virtual exercise based on the plurality of rehabilitation action data 19 and the rehabilitation table data 18. Rehabilitation table 57, through the virtual hand 5, you can pull at least one of the rehabilitation action pictures 58 to at least one arrangement area 571 of the virtual rehabilitation table 57. The operation is like a continuous viewing, which is not only convenient and intuitive to operate, but also more It helps users learn what kind of rehabilitation behaviors should be followed after assessing muscle strength, so that a complete muscle strength assessment program can be completed.

值得一提的是,該系統建構單元1另包含有一評分模組17,該評分模組17接收來自該處理單元41傳遞之資料進而判斷使用者是否依循該訓練流程2及正確性,進而生成一評分表資料傳遞予該顯示單元42中以顯示出一評分表56;其中,該評分表56包含有一分數561及一提醒區562,該分數561可進行紀錄而讓使用者透過歷史資訊來了解自我是否有進步,該提醒區562用以成列出未達標的該評分項目,以便於讓使用者操作完畢後能夠立即得知何處有缺失,進而於下次改進。於本實施例中,該評分模組17係針對複數評分項目分別進行評分,該複數評分項目之權重可進行調整改變以便對應於不同需求及不同強化方向。It is worth mentioning that the system construction unit 1 also includes a scoring module 17. The scoring module 17 receives the data transmitted from the processing unit 41 and determines whether the user follows the training process 2 and its correctness, and then generates a The scoring table data is transmitted to the display unit 42 to display a scoring table 56; wherein, the scoring table 56 includes a score 561 and a reminder area 562. The score 561 can be recorded to allow the user to understand himself through historical information. Whether there is progress, the reminder area 562 is used to list the scoring items that have not reached the standard, so that the user can immediately know where there are deficiencies after completing the operation, and then improve next time. In this embodiment, the scoring module 17 scores multiple scoring items respectively, and the weights of the multiple scoring items can be adjusted and changed to correspond to different needs and different strengthening directions.

較佳地,該系統建構單元1另包含有一首頁資料16,該顯示單元42依據該首頁資料16顯示出一虛擬首頁55,該虛擬首頁55包含有一使用單位551、一使用編號552、一使用者代稱553,如此可以清楚的對所有使用者進行分門別類,且可針對不同該使用單元551進行客製化內容。Preferably, the system building unit 1 further includes a homepage data 16, and the display unit 42 displays a virtual homepage 55 based on the homepage data 16. The virtual homepage 55 includes a user unit 551, a user number 552, and a user. Name 553, so that all users can be clearly classified, and content can be customized for different usage units 551.

1:系統建構單元 11:虛擬受測者設定模組 111:待檢測肌肉群項目 12:虛擬環境資料 13:對話腳本 14:肌肉群圖形資料 15:評估表資料 16:首頁資料 17:評分模組 18:復健表資料 19:復健動作資料 2:訓練流程 21:檢測部位功能選擇步驟 22:檢測圖形選擇步驟 23:檢測姿勢選擇步驟 24:評估步驟 25:復健安排步驟 3:手部感應器 4:虛擬實境單元 41:處理單元 42:顯示單元 43:語音辨識單元 44:撥音單元 5:虛擬手部 51:虛擬受測者 52:虛擬環境 53:肌肉群圖 54:虛擬肌力評估表 55:虛擬首頁 551:使用單位 552:使用編號 553:使用者代稱 56:評分表 561:分數 562:提醒區 57:虛擬復健表 571:安排區 58:復健動作圖片 1: System building unit 11: Virtual subject setting module 111: Muscle group items to be tested 12:Virtual environment information 13: Dialogue script 14: Muscle group graphic information 15: Evaluation form information 16: Home page information 17: Scoring module 18: Rehabilitation table information 19: Rehabilitation action information 2: Training process 21: Detection part function selection steps 22: Detection graphics selection steps 23: Detection posture selection steps 24: Evaluation steps 25: Rehabilitation Arrangement Steps 3:Hand sensor 4:Virtual reality unit 41: Processing unit 42:Display unit 43: Speech recognition unit 44: Dial unit 5: Virtual hand 51: Virtual subject 52:Virtual environment 53: Muscle group map 54:Virtual muscle strength assessment form 55:Virtual Home Page 551:Use unit 552:Use number 553: User name 56: Rating form 561:Score 562: Reminder area 57:Virtual Rehabilitation Table 571:Arrangement area 58: Rehabilitation action pictures

圖1為本發明一實施例之結構關係方塊圖。 圖2為本發明一實施例之訓練流程圖。 圖3為本發明一實施例之實際操作之示意圖。 圖4為本發明一實施例之虛擬首頁之示意圖。 圖5為本發明一實施例之後端設定示意圖。 圖6為本發明一實施例之檢測部位功能選擇之示意圖。 圖7為本發明一實施例之檢測圖形選擇之示意圖。 圖8為本發明一實施例之檢測姿勢選擇之示意圖。 圖9為本發明一實施例之虛擬受測者躺姿進行評估之示意圖。 圖10為本發明一實施例之虛擬受測者坐姿進行評估之示意圖。 圖11為本發明一實施例之復健安排之示意圖。 圖12為本發明一實施例之評分表之示意圖。 Figure 1 is a block diagram of the structural relationship of an embodiment of the present invention. Figure 2 is a training flow chart of an embodiment of the present invention. Figure 3 is a schematic diagram of the actual operation of an embodiment of the present invention. Figure 4 is a schematic diagram of a virtual homepage according to an embodiment of the present invention. Figure 5 is a schematic diagram of backend settings according to an embodiment of the present invention. FIG. 6 is a schematic diagram of function selection of a detection part according to an embodiment of the present invention. FIG. 7 is a schematic diagram of detection pattern selection according to an embodiment of the present invention. FIG. 8 is a schematic diagram of detection posture selection according to an embodiment of the present invention. Figure 9 is a schematic diagram of a virtual subject's lying posture assessment according to an embodiment of the present invention. Figure 10 is a schematic diagram of a virtual subject's sitting posture for assessment according to an embodiment of the present invention. Figure 11 is a schematic diagram of a rehabilitation arrangement according to an embodiment of the present invention. Figure 12 is a schematic diagram of a scoring table according to an embodiment of the present invention.

2:訓練流程 2: Training process

21:檢測部位功能選擇步驟 21: Detection part function selection steps

22:檢測圖形選擇步驟 22: Detection graphics selection steps

23:檢測姿勢選擇步驟 23: Detection posture selection steps

24:評估步驟 24: Evaluation steps

25:復健安排步驟 25: Rehabilitation Arrangement Steps

Claims (10)

一種肌力評估教學虛擬實境系統,包括: 一系統建構單元,包含有一虛擬受測者設定模組、一虛擬環境資料、一對話腳本、複數肌肉群圖形資料、一評估表資料及一訓練流程,該虛擬受測者設定模組包含有複數待檢測肌肉群項目,該複數待檢測肌肉群項目分別預設有相對應的肌力等級,該對話腳本包含有複數回應句及複數關鍵字,該複數肌肉群圖形資料分別對應該複數待檢測肌肉群項目,該訓練流程包含有一檢測部位功能選擇步驟、一檢測圖形選擇步驟、一檢測姿勢選擇步驟、一評估步驟,該檢測部位功能選擇步驟用以選擇預測試之該肌肉群項目,該檢測圖形選擇步驟為選擇與待檢測該肌肉群項目相符合的圖片,該檢測姿勢選擇步驟用以選擇躺姿或坐姿,該評估步驟為分析待檢測該肌肉群項目之肌力狀態;及 一虛擬實境單元,包含有一手部感應器、一處理單元、一顯示單元及一語音辨識單元,該手部感應器供配戴於使用者之手部以偵測手部動作及位置,進而得到一即時動作資料,該處理單元通訊連接該手部感應器以獲取該即時動作資料並將運算後之訊息傳遞予該顯示單元以同步顯示出一虛擬手部,該處理單元通訊連接該系統建構單元並將設定後該虛擬受測者設定模組、該虛擬環境資料、該複數肌肉群圖形資料、該評估表資料遞予該顯示單元以顯示出虛擬受測者、一虛擬環境、複數肌肉群圖、一虛擬肌力評估表,該虛擬受測者、該虛擬環境、該複數肌肉群圖、該虛擬肌力評估表定義為一互動單元,該處理單元透過該虛擬手部與該互動單元之相對位置及動作判斷出一操作狀態,進而該處理單元令該互動單元產生與該操作狀態相匹配之變化並顯示於該顯示單元,該語音辨識單元通訊連接該處理單元,該語音辨識單元傳遞一即時音訊資料予該處理單元,該處理單元比對該即時音訊資料及該複數關鍵字,當該處理單元判斷出該即時音訊資料包含有至少一該關鍵字時,該處理單元令該虛擬受測者依據該虛擬受測者設定模組之設定狀態回應出與至少一該關鍵字相匹配之至少一該回應句或做出與至少一該關鍵字相匹配之動作變化。 A virtual reality system for muscle strength assessment teaching, including: A system building unit includes a virtual subject setting module, a virtual environment data, a dialogue script, a plurality of muscle group graphic data, an evaluation form data and a training process. The virtual subject setting module includes a plurality of Muscle group items to be detected, the plurality of muscle group items to be detected are respectively preset with corresponding muscle strength levels, the dialogue script includes plural response sentences and plural keywords, and the plurality of muscle group graphic data respectively correspond to the plurality of muscles to be detected group items, the training process includes a detection part function selection step, a detection pattern selection step, a detection posture selection step, and an evaluation step. The detection part function selection step is used to select the muscle group item for pre-test, and the detection pattern The selection step is to select pictures that match the muscle group item to be detected, the detection posture selection step is to select a lying posture or a sitting posture, and the evaluation step is to analyze the muscle strength status of the muscle group item to be detected; and A virtual reality unit includes a hand sensor, a processing unit, a display unit and a voice recognition unit. The hand sensor is worn on the user's hand to detect hand movements and positions, and then Obtaining real-time motion data, the processing unit communicates with the hand sensor to obtain the real-time motion data and transmits the calculated information to the display unit to simultaneously display a virtual hand. The processing unit communicates with the system structure The unit will deliver the set virtual subject setting module, the virtual environment data, the plurality of muscle group graphic data, and the evaluation form data to the display unit to display the virtual subject, a virtual environment, and multiple muscle groups. Figure, a virtual muscle strength evaluation table, the virtual subject, the virtual environment, the plurality of muscle group diagrams, and the virtual muscle strength evaluation table are defined as an interactive unit, and the processing unit communicates with the interactive unit through the virtual hand The relative position and action determine an operating state, and then the processing unit causes the interactive unit to produce changes that match the operating state and display them on the display unit. The voice recognition unit is connected to the processing unit through communication, and the voice recognition unit transmits a The real-time audio data is given to the processing unit, and the processing unit compares the real-time audio data with the plurality of keywords. When the processing unit determines that the real-time audio data contains at least one of the keywords, the processing unit makes the virtual subject The person responds with at least one response sentence that matches at least one of the keywords or makes an action change that matches at least one of the keywords based on the setting status of the virtual subject setting module. 如請求項1所述的肌力評估教學虛擬實境系統,其中該虛擬實境單元另包含有一撥音單元,該撥音單元通訊連接該處理單元以撥放至少一該回應句。The muscle strength assessment teaching virtual reality system as described in claim 1, wherein the virtual reality unit further includes a dialing unit, and the dialing unit is communicatively connected to the processing unit to play at least one of the response sentences. 如請求項1所述的肌力評估教學虛擬實境系統,其中該系統建構單元另包含有一首頁資料,該顯示單元依據該首頁資料顯示出一虛擬首頁,該虛擬首頁包含有一使用單位、一使用編號、一使用者代稱。The muscle strength assessment teaching virtual reality system as described in claim 1, wherein the system construction unit further includes a homepage data, the display unit displays a virtual homepage based on the homepage data, and the virtual homepage includes a user unit, a user Number, user name. 如請求項1所述的肌力評估教學虛擬實境系統,其中該系統建構單元另包含有一評分模組,該評分模組接收來自該處理單元傳遞之資料進而判斷使用者是否依循該訓練流程及正確性,進而生成一評分表資料傳遞予該顯示單元中以顯示出一評分表。The muscle strength assessment teaching virtual reality system as described in claim 1, wherein the system building unit further includes a scoring module, which receives the data transmitted from the processing unit and determines whether the user follows the training process and correctness, and then generate a scoring table data and pass it to the display unit to display a scoring table. 如請求項4所述的肌力評估教學虛擬實境系統,其中該評分模組係針對複數評分項目分別進行評分,該複數評分項目之權重可進行調整改變。The muscle strength assessment teaching virtual reality system as described in claim 4, wherein the scoring module scores multiple scoring items respectively, and the weights of the plurality of scoring items can be adjusted and changed. 如請求項4所述的肌力評估教學虛擬實境系統,其中該評分表包含有一分數及一提醒區,該提醒區用以成列出未達標的該評分項目。The muscle strength assessment teaching virtual reality system as described in claim 4, wherein the scoring table includes a score and a reminder area, and the reminder area is used to list the scoring items that fail to meet the standards. 如請求項1至6其中任一項所述的肌力評估教學虛擬實境系統,其中該複數待檢測肌肉群項目之肌力等級可進行調整改變,進而於該顯示單元中該虛擬受測者會有不同的動作表現。The muscle strength assessment teaching virtual reality system as described in any one of claims 1 to 6, wherein the muscle strength levels of the plurality of muscle group items to be tested can be adjusted and changed, so that the virtual subject in the display unit There will be different actions. 如請求項1至6其中任一項所述的肌力評估教學虛擬實境系統,其中該訓練流程另包含有一復健安排步驟,該系統建構單元另包含有複數復健動作資料,該復健安排步驟為依據檢測後該肌肉群項目之肌力等級來選擇相對的該復健動作資料。The muscle strength assessment teaching virtual reality system as described in any one of claims 1 to 6, wherein the training process further includes a rehabilitation arrangement step, the system construction unit further includes a plurality of rehabilitation action data, and the rehabilitation The arrangement step is to select the corresponding rehabilitation action data based on the muscle strength level of the muscle group after testing. 如請求項8所述的肌力評估教學虛擬實境系統,其中該系統建構單元另包含有一復健表資料,該顯示單元中依據該複數復健動作資料及該復健表資料顯示出複數復健動作圖片及一虛擬復健表,透過該虛擬手部可分別拉動至少一該復健動作圖片至該虛擬復健表之至少一安排區。The muscle strength assessment teaching virtual reality system as described in claim 8, wherein the system construction unit further includes a rehabilitation table data, and the display unit displays a plurality of complex data based on the plurality of rehabilitation action data and the rehabilitation table data. There are fitness action pictures and a virtual rehabilitation table. At least one of the rehabilitation action pictures can be pulled to at least one arrangement area of the virtual rehabilitation table through the virtual hand. 如請求項6所述的肌力評估教學虛擬實境系統,其中該虛擬實境單元另包含有一撥音單元,該撥音單元通訊連接該處理單元以撥放至少一該回應句;該系統建構單元另包含有一首頁資料,該顯示單元依據該首頁資料顯示出一虛擬首頁,該虛擬首頁包含有一使用單位、一使用編號、一使用者代稱;該評分模組係針對複數評分項目分別進行評分,該複數評分項目之分數可進行調整改變;該複數待檢測肌肉群項目之肌力等級可進行調整改變,進而於該顯示單元中該虛擬受測者會有不同的動作表現;該訓練流程另包含有一復健安排步驟,該系統建構單元另包含有複數復健動作資料,該復健安排步驟為依據檢測後該肌肉群項目之肌力等級來選擇相對的該復健動作資料;該系統建構單元另包含有一復健表資料,該顯示單元中依據該複數復健動作資料及該復健表資料顯示出複數復健動作圖片及一虛擬復健表,透過該虛擬手部可分別拉動至少一該復健動作圖片至該虛擬復健表之至少一安排區;肌力等級分成0、1、2、3、4、5級;該虛擬實境單元係為頭戴式裝置;該顯示單元另會將該虛擬受測者的至少一該回應句以字幕方式顯示出來。The muscle strength assessment teaching virtual reality system as described in claim 6, wherein the virtual reality unit further includes a dialing unit, which is communicatively connected to the processing unit to play at least one of the response sentences; the system construction unit further Contains a homepage data, and the display unit displays a virtual homepage based on the homepage data. The virtual homepage includes a user unit, a user number, and a user name; the scoring module separately scores multiple scoring items, and the plurality of scoring items are scored separately. The scores of the scoring items can be adjusted and changed; the muscle strength levels of the plurality of muscle group items to be tested can be adjusted and changed, so that the virtual subject will have different action performances in the display unit; the training process also includes a complex The fitness arrangement step, the system building unit also includes a plurality of rehabilitation action data, the rehabilitation arrangement step is to select the corresponding rehabilitation action data based on the muscle strength level of the muscle group after testing; the system building unit also includes There is a rehabilitation table data. The display unit displays a plurality of rehabilitation action pictures and a virtual rehabilitation table based on the plurality of rehabilitation action data and the rehabilitation table data. At least one of the rehabilitation tables can be pulled through the virtual hand respectively. action pictures to at least one arrangement area of the virtual rehabilitation table; muscle strength levels are divided into levels 0, 1, 2, 3, 4, and 5; the virtual reality unit is a head-mounted device; the display unit will also display the At least one response sentence of the virtual subject is displayed in the form of subtitles.
TW111112719A 2022-04-01 2022-04-01 Virtual reality system for muscle strength scale teaching TWI799223B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW111112719A TWI799223B (en) 2022-04-01 2022-04-01 Virtual reality system for muscle strength scale teaching

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW111112719A TWI799223B (en) 2022-04-01 2022-04-01 Virtual reality system for muscle strength scale teaching

Publications (2)

Publication Number Publication Date
TWI799223B TWI799223B (en) 2023-04-11
TW202340913A true TW202340913A (en) 2023-10-16

Family

ID=86948644

Family Applications (1)

Application Number Title Priority Date Filing Date
TW111112719A TWI799223B (en) 2022-04-01 2022-04-01 Virtual reality system for muscle strength scale teaching

Country Status (1)

Country Link
TW (1) TWI799223B (en)

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW355137B (en) * 1998-06-24 1999-04-01 Ming-Yi Li A virtual reality rehabilitory training apparatus
WO2019241799A1 (en) * 2018-06-15 2019-12-19 Viribus Vr Labs, Llc Virtual reality therapy system and methods of making and using same
KR102094294B1 (en) * 2018-08-02 2020-03-31 주식회사 엑소시스템즈 Rehabilitation system performing rehabilitation program using wearable device and user electronic device
CN109199417A (en) * 2018-09-06 2019-01-15 中山大学 A kind of augmented reality method and system for athletic rehabilitation treatment
CN109363888A (en) * 2018-11-14 2019-02-22 华南理工大学 A kind of immersion rehabilitation training of upper limbs system
CN110570946A (en) * 2019-09-05 2019-12-13 东北大学 Lower limb rehabilitation robot rehabilitation training motor function rehabilitation evaluation method
CN111459450A (en) * 2020-03-31 2020-07-28 北京市商汤科技开发有限公司 Interactive object driving method, device, equipment and storage medium
CN112451306B (en) * 2020-10-26 2022-06-21 深圳市康乐福科技有限公司 Arm muscle rehabilitation training system based on VR

Also Published As

Publication number Publication date
TWI799223B (en) 2023-04-11

Similar Documents

Publication Publication Date Title
Hsiao et al. Using a gesture interactive game-based learning approach to improve preschool children's learning performance and motor skills
Hsiao et al. Body language and augmented reality learning environment
Chang et al. Errata: A Situated Cultural Festival Learning System Based on Motion Sensing
Gumonan et al. ASIAVR: asian studies virtual reality game a learning tool
Sackl et al. Social robots as coaches: How human-robot interaction positively impacts motivation in sports training sessions
KR20180097343A (en) System for training of CPR(cardiopulmonary resuscitation)
Babu et al. Learning cultural conversational protocols with immersive interactive virtual humans
Hania et al. DEVELOPMENT OF CEFR-BASED QOWA'ID LEARNING EVALUATION TOOL WITH THE HELP OF WORDWALL INTERACTIVE GAMESTO IDENTIFY STUDENTS'UNDERSTANDING
Torres et al. Learning how to play a guitar with the HoloLens: A case study
TWI799223B (en) Virtual reality system for muscle strength scale teaching
Lamanauskas et al. Evaluating the educational value and usability of an augmented reality platform for school environments: some preliminary results
JP6794992B2 (en) Information processing equipment, information processing methods, and programs
Chou et al. Design of motion sensing martial art learning system
Hsiao et al. The development of the AR-fitness system in education
TWM632566U (en) Virtual reality training device for muscle strength assessment
Nelson et al. Karate in the digital age: Augmented reality for enhanced learning and performance
CN113257100A (en) Remote ultrasonic teaching system
TW202341095A (en) Virtual reality training system for comprehensive geriatric assessment
Luo et al. Status and Trend: The Application of Educational VR Games in Teaching Chinese as a Foreign Language
KR20180097324A (en) Method for training of CPR(cardiopulmonary resuscitation)
He et al. Virtual Reality Technology in the Teaching of Sports Dance in Colleges and Universities
Chong et al. An Empathetic Approach to Human-Centric Requirements Engineering Using Virtual Reality
Indarto et al. Schoology-Based Learning Management Development On Badminton Courses
TWM632565U (en) Virtual reality training device for comprehensive geriatric assessment
Кавилова Interactive approaches for foreign language instruction