TWI788249B - Virtual reality training system for comprehensive geriatric assessment - Google Patents

Abstract

The present invention relates to a virtual reality Training system for comprehensive geriatric assessment, so that users can obtain a live experience through the virtual reality, and through continuous simulation exercises, the overall learning effect and the purpose of practical application are improved.

Description

Virtual Reality Training System for Comprehensive Assessment of the Elderly

The invention relates to a virtual reality training system for comprehensive evaluation of the elderly.

In the process of studying, students can learn a variety of knowledge through various types of course teaching, and can understand the actual work content of the industry, and then find their own hobbies and future goals. However, understanding the industry content, implementation principles, and working steps in the classroom does not mean that it can be used and implemented in real life. Strong theory but poor practice will only be reduced to empty talk, while strong practice but lack of theory will be limited to the existing environment and affairs, and cannot be further extended and refined. Therefore, theory and practice must complement each other and cannot be neglected.

The main ideal goal of the University of Science and Technology is to give consideration to both theory and practice, so that students can apply the knowledge, methods, and steps learned in the classroom to life and work, so as to achieve the purpose of applying what they have learned. For example, in the Comprehensive Assessment Course for the Elderly, although oral, paper, video teaching or teacher-student simulations are used in the classroom, the people and things they encounter in the workplace are more varied, and how to make students It is an urgent problem to think about at present to be able to truly apply what is learned in the classroom to the workplace and life, and to achieve the goal of integrating learning and application in technical and vocational education.

Therefore, it is necessary to provide a novel and progressive virtual reality training system for comprehensive assessment of the elderly to solve the above-mentioned problems.

The main purpose of the present invention is to provide a virtual reality training system for the comprehensive evaluation of the elderly, which can allow learners to obtain the experience of being on the spot through the visual presence effect of virtual reality (Virtual Reality), and improve the quality of life through continuous simulation exercises. Willingness to learn to achieve the purpose of improving learning effectiveness.

To achieve the above purpose, the present invention provides a virtual reality training system for comprehensive assessment of the elderly, which includes a system construction unit and a virtual reality unit. The system construction unit includes a virtual test subject setting module, a virtual environment data, a question script, an evaluation form data and a training process, and the virtual test subject setting module includes a cognitive function to be tested and physical activity As for the function to be tested item, the cognitive function to be tested item is preset with plural cognitive function scripts, the physical activity function to be tested item is preset with multiple physical activity function scripts, and the query script includes plural keywords. The virtual reality unit includes a hand sensor, a processing unit, a display unit, and a voice recognition unit. The hand sensor is worn on the user's hand to detect hand movements and positions. The processing The unit communicates with the hand sensor and transmits the detected hand motion and position calculation to the display unit to display a virtual hand synchronously. The processing unit communicates with the system construction unit and sets the virtual hand. The test subject setting module, the virtual environment data, and the evaluation form data are passed to the display unit to display a virtual test subject, a virtual environment, a comprehensive assessment form, the virtual test subject, the virtual environment, The comprehensiveness evaluation table is defined as an interaction unit, the processing unit judges an operation state through the relative position and movement of the virtual hand and the interaction unit, and then the processing unit makes the interaction unit produce an action that matches the operation state Change and display on the display unit, the voice recognition unit communicates with the processing unit, the voice recognition unit transmits a real-time audio data to the processing unit, and the processing unit compares the real-time audio data and the keywords, when the processing When the unit judges that the real-time audio data includes a keyword, the processing unit makes the virtual test subject return to the set state according to the virtual test subject setting module. One of the cognitive function script and the physical activity function script matching the keyword is selected. Wherein, the training process includes a category selection step and an evaluation step, the category selection step is used to select one of the cognitive function to be tested and the physical activity function to be tested, the assessment step is to analyze the cognitive function to be tested The test item and the ability status of one of the items to be tested for the physical activity function.

1: System building unit

11: Virtual subject setting module

12: Virtual environment information

13: Question script

131: Keyword

14: Evaluation form information

15: Cognitive function items to be tested

151: Cognitive Function Script

16: Items to be tested for physical activity function

161: Physical Activity Functional Script

17: Home page information

171: Using units

172: Use number

173: user pronoun

18: Scoring Module

181: Grading Items

2: Training process

21: Type selection step

22: Evaluation Step

23: Ability status

24: Suggestions for medical diagnosis

3: Virtual reality unit

31: Hand sensor

32: Processing unit

33: Display unit

34:Speech recognition unit

35: Broadcast unit

41:Virtual hand

42: Virtual Subjects

43:Virtual environment

44:Comprehensive Evaluation Form

5: Scoring Form

51: score

52: Reminder area

Fig. 1 is a block diagram of the structural relationship of an embodiment of the present invention.

Fig. 2 is a training flowchart of an embodiment of the present invention.

Fig. 3 is a schematic diagram of the actual operation of an embodiment of the present invention.

Fig. 4 is a schematic diagram of the homepage data of an embodiment of the present invention.

FIG. 5 is a schematic diagram of a scoring module according to an embodiment of the present invention.

FIG. 6 is a schematic diagram of selecting a detection type according to an embodiment of the present invention.

FIG. 7 and FIG. 8 are schematic diagrams of physical activity function detection according to an embodiment of the present invention.

FIG. 9 and FIG. 10 are schematic diagrams of the cognitive function to be tested according to an embodiment of the present invention.

Fig. 11 is a schematic diagram of a scoring table according to an embodiment of the present invention.

The following examples illustrate possible implementations of the present invention, but are not intended to limit the scope of protection of the present invention.

Please refer to FIGS. 1 to 11 , which show a preferred embodiment of the present invention. The virtual reality training system for comprehensive evaluation of the elderly of the present invention includes a system construction unit 1 and a virtual reality unit 3 .

The system construction unit 1 includes a virtual test subject setting module 11, a virtual environment data 12, a question script 13, an evaluation table data 14 and a training process 2, and the virtual test subject setting module 11 includes a cognition The function to be detected item 15 and the physical activity function to be detected item 16, the cognitive function to be detected item 15 is preset with a plurality of cognitive function scripts 151, the physical activity function to be detected item 16 is preset with a plurality of physical activity function scripts 161, the question The script 13 includes plural keywords 131 .

The virtual reality unit 3 includes a hand sensor 31, a processing unit 32, a display unit 33, and a voice recognition unit 34. The hand sensor 31 is worn on the user's hand to detect the hand Action and position, the processing unit 32 communicates with the hand sensor 31 and transmits the detected hand action and position calculation to the display unit 33 to simultaneously display a virtual hand 41, the processing unit 32 communicates Connect the system construction unit 1 and deliver the virtual subject setting module 11, the virtual environment data 12, and the evaluation form data 14 to the display unit 33 after setting to display a virtual subject 42 and a virtual environment 43. A comprehensive assessment form 44, the virtual subject 42, the virtual environment 43, and the comprehensive assessment form 44 are defined as an interactive unit, and the processing unit 32 uses the relative position of the virtual hand 41 and the interactive unit And the action determines an operation state, and then the processing unit 32 causes the interaction unit to generate a change matching the operation state and display it on the display unit 33, so as to achieve the purpose of real-world and virtual interaction. The speech recognition unit 34 is communicatively connected to the processing unit 32, the speech recognition unit 34 transmits an instant audio data to the processing unit 32, and the processing unit 32 compares the instant audio data and the keywords 131, when the processing unit 32 When judging that the real-time audio data contains a keyword 131, the processing unit 32 makes the virtual subject 42 respond to the cognition matching the keyword 131 according to the setting state of the virtual subject setting module 11. One of the functional script 151 and the physical activity functional script 161 .

Wherein, the training process 2 includes a category selection step 21 and an evaluation step 22, the category selection step 21 is used to select the cognitive function to be detected item 15 and the physical activity function to be detected item One of the items 16 is performed, and the evaluation step 22 is to analyze the ability state 23 of one of the cognitive function to be detected item 15 and the physical activity function to be detected item 16 .

Furthermore, the virtual reality unit 3 further includes a broadcast unit 35, which is communicatively connected to the processing unit 32 to play one of the cognitive function script 151 and the physical activity function script 161, so that the user and A sense of interactive dialogue is generated between the virtual subjects 42 .

In this embodiment, the system construction unit 1 further includes a home page data 17, and the display unit 33 displays a home page data 17 according to the home page data 17, and the home page data 17 includes a user unit 171, a use number 172, a The user code name is 173. In this way, all users can be clearly categorized, and customized content can be carried out for different usage units.

Preferably, the system construction unit 1 further includes a scoring module 18, the scoring module 18 receives the data transmitted from the processing unit 32 and then judges whether the user follows the training process 2 and correctness, and then generates a scoring table 5 is transmitted to the display unit 33.

Wherein, the scoring module 18 performs scoring on the multiple scoring items 181 respectively, and the scores 51 of the multiple scoring items 181 can be adjusted and changed. Therefore, if this system is used in a school, the setting value can be set by the teacher.

In this embodiment, the virtual reality unit 3 is a head-mounted device, and the display unit 33 will also display the cognitive function script 151 and the physical activity function script 161 in the form of subtitles, so that the user can visually, Listening and other different ways to receive information, in other embodiments, the virtual reality unit 3 can also be a computer.

Specifically, the physical activity function script 161 includes at least one of shopping, going out, food cooking, housework maintenance, washing clothes, using the phone, taking medicine, handling financial ability, etc., and the ability status 23 is divided into 0 and 1. , Level 2, 3, and 4, the user follows the physical activity function script 161 The content judges which digital grade matches the evaluation. For example, when the user speaks a question, the voice recognition unit 34 converts the question into instant audio data. When the processing unit 32 recognizes the keyword 131 "going out", The body activity function script 161 plays the corresponding script about going out (as shown in FIGS. 7 and 8 ). The cognitive function script 151 includes at least one of reduced interest in activities and hobbies, repeated same questions, tool use barriers, and ability to handle finances. Whether the content judgment changes the cognitive function is evaluated. For example, when the user speaks a question sentence, the speech recognition unit 34 converts the question sentence into real-time audio data, and when the processing unit 32 recognizes the keyword 131 "interest", the The cognitive function script 151 then plays the corresponding interest-related script (as shown in FIGS. 9 and 10 ).

In addition, the training process 2 further includes a step of seeking medical advice, and the step of seeking medical advice provides a suggestion 24 for further medical diagnosis according to the ability state 23 .

It is worth mentioning that the scoring table 5 includes a score 51 and a reminder area 52 , and the reminder area 52 is used to list the scoring items 181 that do not meet the standard. The score 51 can be recorded so that the user can know whether he has improved through historical information, and the reminder area 52 is used to list the scoring items 181 that have not reached the standard, so that the user can know immediately after the operation is completed. There are deficiencies, and then it will be improved next time. In this embodiment, the scoring module 18 performs scoring on the multiple scoring items 181 respectively, and the scores 51 of the multiple scoring items 181 can be adjusted and changed for use in different cases.

2: Training process

21: Type selection step

22: Evaluation Step

23: Ability status

24: Suggestions for medical diagnosis

Claims (6)

A virtual reality training system for comprehensive assessment of the elderly, including: a system construction unit, including a virtual subject setting module, a virtual environment data, a question script, an evaluation form data and a training process, the virtual subject The examiner setting module includes a cognitive function to be detected item and a physical activity function to be detected item, the cognitive function to be detected item is preset with multiple cognitive function scripts, and the physical activity function to be detected item is preset with multiple physical activity function scripts, The question script includes plural keywords; a virtual reality unit includes a hand sensor, a processing unit, a display unit and a speech recognition unit, and the hand sensor is worn on the user's hand to detect Detecting hand movements and positions, the processing unit communicates with the hand sensor and transmits the detected hand movements and positions to the display unit to synchronously display a virtual hand, the processing unit communicates with the The system construction unit sends the virtual subject setting module, the virtual environment data, and the evaluation form data to the display unit after setting to display a virtual subject, a virtual environment, and a comprehensive evaluation form. The virtual subject, the virtual environment, and the comprehensive evaluation form are defined as an interaction unit, and the processing unit judges an operation state through the relative position and movement of the virtual hand and the interaction unit, and then the processing unit makes the interaction The unit produces a change that matches the operating state and displays it on the display unit. The speech recognition unit communicates with the processing unit. The speech recognition unit transmits a real-time audio data to the processing unit, and the processing unit compares the real-time audio data. and the keywords, when the processing unit determines that the instant audio data contains a keyword, the processing unit makes the virtual subject respond to the keyword according to the setting state of the virtual subject setting module Matching one of the cognitive function script and the physical activity function script; Wherein, the training process includes a category selection step and an evaluation step, the category selection step is used to select one of the cognitive function to be tested and the physical activity function to be tested, the assessment step is to analyze the cognitive function to be tested The test item and the ability status of one of the items to be tested for the physical activity function; wherein, the system construction unit further includes a scoring module, which receives the data transmitted from the processing unit and then judges whether the user follows the training process and correctness, and then generate a scoring table and pass it to the display unit; the scoring module is for scoring multiple scoring items, and the scores of the multiple scoring items can be adjusted and changed; wherein, the training process also includes a medical consultation Suggestion steps, the medical advice step provides advice on further medical diagnosis according to the ability status; the physical activity function script includes shopping on the street, going out, cooking food, maintaining housework, washing clothes, using the phone, taking medicine, handling financial ability Waiting for at least one of them, the ability status is divided into 0, 1, 2, 3, 4 levels. The virtual reality training system for comprehensive assessment of the elderly as described in claim 1, wherein the virtual reality unit further includes a broadcast unit, and the broadcast unit is connected to the processing unit in communication to play the cognitive function script and the physical activity function script one of them. The virtual reality training system for comprehensive assessment of the elderly as described in claim 1, wherein the system construction unit further includes a home page data, and the display unit displays a home page data according to the home page data, and the home page data includes a user unit , a use number, and a user name. The virtual reality system for comprehensive assessment of the elderly as described in Claim 1, wherein the scoring table includes a score and a reminder area, and the reminder area is used to list the scoring items that do not meet the standard. The virtual reality training system for comprehensive assessment of the elderly as described in claim 1, wherein the virtual reality unit is a head-mounted device, and the display unit will also display the cognitive function script and the physical activity function script in the form of subtitles show. The virtual reality training system for comprehensive assessment of the elderly as described in Claim 1, wherein the cognitive function script includes at least one of decreased interest in activities and hobbies, repetition of the same question, obstacles in using tools, and ability to handle finances, etc., The capability status is divided into yes and no.

Images