TWI773014B - Virtual reality interactive self-learning system - Google Patents

Abstract

The present invention reveals Virtual Reality Interactive Self-Learning System, including a server and more than one participant. More than one participant uses an electronic device to connect the server. The electronic devicereceives the command from the server and generates an image. The server scores and records the data which form from the result of the participantaccording to the scoring logic. The Virtual Reality Interactive Self-Learning System can improve the learning motivation and interest of the participant. The participant can further link the content of learning with the experience from the Virtual Reality Interactive Self-Learning System to internalize the knowledge and to enhance the learning effect.

Description

Virtual reality interactive self-learning system

A teaching system, especially a virtual reality interactive self-learning system.

The general traditional learning process is that a teacher presents one subject or one textbook content in the course, summarizes a key point in an oral or a handout, and uses an exam to test a student's learning status, and the student uses Memorize the way the teacher summarizes the key points to deal with the test. Teaching in the way of cramming often causes the student to lose interest in the subject and reduce learning performance; and over time, the content of the subject is easily forgotten, resulting in poor overall learning effect. Therefore, creating a learning method that can arouse a student's interest in learning, enhance the learning effect, and help the student to memorize the content of the subject has become an extremely important issue.

In order to develop a learning method that can arouse a student's interest in learning, improve the learning effect, and help the student's memory, the present invention provides a virtual reality interactive autonomous learning system, which includes: a server for providing One or more host terminals and one or more participating terminals use an electronic device to log in through an Internet, the electronic device receives the server's instruction and generates an image, and captures the motion data and the sound data of the participating terminal sent to this server.

Wherein, the server includes: a personnel system, a teaching system and a management system, the personnel system accepts a participant login, and records a test result of the participant in each learning course, and according to the test result Schedule more than one study session suitable for that participant.

Wherein, the teaching system includes: a contextual course module, a message sending and receiving module, and an extended contextual module, the contextual course module stores a plurality of the learning courses, and more than one key point corresponding to each of the learning courses, the The situational course module outputs the selected learning course and one or more key points. The situational course module includes a processing unit, and the processing unit stores a scoring logic corresponding to each learning course. The processing unit is based on the scoring logic. The participating terminal scores an action data and a sound data in one of the learning courses, generates the test result, and stores the test result in the personnel system, and the message transceiver module is responsible for transmitting the teaching system to output the learning course and one or more of the key points to the electronic device, the electronic device generates the image corresponding to the learning course and one or more of the key points, and receives the action data and the sound data recorded from the electronic device, the extended context module can be real-time combine the action data with the context module, convert the action data of the participant into a real-time image and send it to the mobile electronic device via the message transceiver module, and the extended context module determines the action data of the participant and the The sound data presents results corresponding to more than one focus of the learning course.

Wherein, one or more of the participating terminals include a head-mounted display, the head-mounted display can accommodate the electronic device and convert the image generated by the electronic device into a stereoscopic scene for delivery. After the learning course is converted into the stereoscopic scene for delivery , the three-dimensional scene includes a toolbox, the toolbox displays more than one relevant key points stored in the corresponding learning course, and the extended context module judges the action data of the participant to generate the corresponding three-dimensional scene.

Wherein, the course unit regularly gives the participant a quiz to measure the level of the participant, and schedules one or more learning courses suitable for the participant.

Wherein, the server includes a management system, the management system stores the personnel systems of all the participating terminals, the management system only opens the authority to the main control terminal, the main control terminal can check all the personnel systems through the management system and Arrange the learning course; the host can edit the teaching system through the management system.

Further, the participating terminal can select the learning course of interest in the teaching system, and inquire and review the test results in each of the learning courses. When the participating terminal experiences the learning course, the corresponding three-dimensional scene can be used. shrinks, expands or moves the toolbox of the real-time image of the hand.

Further, performing one of the learning course steps by the participant terminal includes: the participant terminal uses the electronic device to download and log in to the server; place the electronic device on the head-mounted display, and then wear the head-mounted display On the user's head of the participating terminal, the user of the participating terminal can view the three-dimensional scene; the participating terminal enters the personnel system and selects one of the learning courses; the selected one of the learning courses and the corresponding One or more of the key points are transmitted to the electronic device through the message transceiver module to start the learning course, during which the electronic device transmits the motion data and the sound data synchronously to the message transceiver module; the processing unit According to the scoring logic, judge the test result of the learning course this time according to the action data and the sound data, and store the test result in the personnel system, and the participant can turn his head to watch or use the learning course The action data opens the toolbox.

Through the learning course of the virtual reality interactive self-learning system, the participating terminal experiences the learning with a sense of presence and utilizes the content of the learning course according to the scene, which can effectively improve the user's learning motivation and interest. The embodied experience of the virtual reality interactive self-learning system can further link the content of the learning course with the experience, and internalize knowledge, so that learning Show better results.

10: Server

11: Personnel System

111: Data Unit

112: Course Units

113: Grade Units

12: Teaching System

121: Situational Lessons Module

1211: Course Repository

1212: Keyword Database

1213: Processing unit

122: Message transceiver module

123: Extended Situation Module

13: Management System

20: Head Mounted Displays

21: Joint

30: Mobile Electronic Devices

31: Processing unit

32: Audio and video unit

33: Display components

40: Steps

50: Toolbox

51: Start key

51A: First start key

51B: Second start key

51C: The third start key

52: Down key

53: Return key

A: The main control terminal

B: Participating side

N: Internet

1 is a schematic diagram of a preferred embodiment of the present invention

FIG. 2 is a system diagram of a preferred embodiment of the present invention

FIG. 3 is a diagram of a server system according to a preferred embodiment of the present invention

FIG. 4 is a schematic diagram of steps of a preferred embodiment of the present invention

Figure 5 is a schematic diagram of the use of the preferred embodiment of the present invention

Referring to FIG. 1 and FIG. 2 , a virtual reality interactive self-learning system includes: a server 10 , more than one master control terminal A, and more than one participating terminal B. As shown in FIG. The server 10 is used for one or more of the master A and more than one of the participating terminals B to log in through a network connection; the one or more masters A and more than one of the participating terminals B each use an electronic device and are connected to Log in to the server 10 through an Internet N, and use the virtual reality interactive self-learning system of the present invention to operate or learn. The host A can be a desktop computer, a mobile electronic device, or other similar computer devices with a network connection function.

The participant B includes a head-mounted display 20 and a mobile electronic device 30 . The head-mounted display 20 is provided with a joint portion 21 , the joint portion 21 includes a display unit, and the joint portion 21 can accommodate the mobile electronic device 30 . , the mobile electronic device 30 includes a processing unit 31 , an audio-visual unit 32 and a display element 33 , the processing unit 31 is connected to the server 10 , receives instructions from the server 10 , places the display element 33 and transmits the audio-visual The unit 32 captures a motion data and a sound data of the participant B, and transmits them to the server 10 . When the display unit should be placed on the joint portion 21 , the display unit converts the image generated by the display element 33 into a stereoscopic scene for delivery.

Please refer to FIG. 3 , the server 10 includes a personnel system 11 , a teaching system 12 and a management system 13 . The personnel system 11 includes a data unit 111 , a course unit 112 and a grade unit 113 . The data unit 111 stores a basic data that the participant B logs into the server, and the participant B can use the data unit 111 Edit the basic information of the individual; the course unit 112 schedules more than one suitable study course according to the level of the participant B, and the participant B can select the study course of interest in the course unit 112; the grade unit 113 Record a test result in each of the learning courses of the participant B. The participant B can query and review the test results in each of the learning courses in the grade unit 113. For example, the course unit 112 can The level of the participant B is determined according to each of the test results, or a test is periodically given to the participant B to measure the level of the participant B.

The teaching system 12 includes a contextual course module 121 , a message transceiving module 122 and an extended contextual module 123 . The contextual course module 121 transmits the learning course selected by the participant B to the message transceiving module 122 , to carry out the study session. The contextual course module 121 includes a course database 1211, a keyword database 1212, and a processing unit 1213. The course database 1211 stores a plurality of the learning courses, and outputs the learning courses according to the selection of the participant B ; The keyword database 1212 records more than one key point of a plurality of the learning courses, and outputs one or more key points corresponding to the course database; the processing unit 1213 is based on a scoring logic stored in the teaching system 12 for the participating terminal B scores the action data and/or the sound data in the learning course to generate the test result, and stores the test result of the participating terminal B each time in the grade unit 113, and the processing unit 1213 determines the participation The action data and/or the sound data of the terminal B generate results corresponding to more than one focus of the course database; the message transceiver module 122 is responsible for transmitting the teaching system 12 to output the course and the focus to the mobile electronic device 30, And, receive the motion data and the sound data recorded from the mobile electronic device 30, and transmit the motion data and the sound data to the processing unit 1213 and the extended context module 123; the extended context module 123 can combine the action data with the context module 121 in real time, and convert the action data of the participant B into a real-time image via the message transceiver module 122 sent.

After the audio data recorded by the participant B through the mobile electronic device 30 is transmitted to the message transceiver module 122, the teaching system 12 stores the audio data in the grade unit 113 via the processing unit 1213, and the participant B can Playing back the audio data through the achievement unit 113 enhances the autonomy of the participant port B speaking practice.

The management system 13 may only be open to the main control terminal A. The management system 13 stores all the personnel systems 11 of the participant terminal B. The main control terminal A can check all the participant terminal B through the management system 13 the personnel system 11 and arranges the learning course according to the level of each participant B; the management system 13 can edit the situational course module 121, and the main control terminal A can add, delete or edit the The course database 1211 , the keyword database 1212 and the processing unit 1213 .

Please refer to FIG. 4 , step 40 when the virtual reality interactive self-learning system of the present invention is used, step 41 : login, the participant B connects the mobile electronic device 30 with the server 10 , and downloads and logs in the The server 10 then places the mobile electronic device 30 on the head-mounted display 20, and then wears the head-mounted display 20 on the user's head of the participant terminal B, and the display unit corresponds to the participant terminal The user's eye of B enables the user of the participant B to view the three-dimensional scene; Step 42 : Select a learning course, the participant B enters the personnel system 11 and selects the learning course in the course unit 112 ; Step 43: Load the course, output the selected learning course and the corresponding focus to the situational course module 121, and transmit it to the mobile electronic device 30 through the message transceiver module 122, the display unit The display element 33 broadcasts the screen into the three-dimensional scene, and the participant B can start the learning course. During the process of experiencing the learning course, the mobile electronic device 30 transmits the motion data and the sound data synchronously to the The message transceiver module 122 processes and then returns the action data/or the sound data through the extended context module 123, and the extended context module 123 determines the participating terminal B. The action data and/or the sound data generate results corresponding to one or more of the key points of the course database; Step 44: Judging the effect, the processing unit 1213 judges the participant according to the action data and the sound data according to the scoring logic B In this test result of this study course, if the result that meets the standard includes: get a reward, improve the level, or enter the next study course; if the result does not meet the standard, the result includes: need to pass the level again, review The study course or other study courses are entered, and each test result and each sound data of the participant B are stored in the grade unit 113 .

Through the learning course of the virtual reality interactive self-learning system, the participating terminal experiences the learning with a sense of presence and utilizes the content of the learning course according to the scene, which can effectively improve the user's learning motivation and interest. The participating terminal B The embodied experience through the virtual reality interactive self-learning system can further link the content of the learning course with the experience, and internalize the knowledge, so that the learning can show better results.

The present invention now takes English teaching as the starting point, and simulates the embodiment of the participant B in the virtual reality interactive self-learning system. Please refer to FIG. 5. When the participant B enters the learning course, the participant B is in front of the Presenting the three-dimensional scene, the participant B can view the three-dimensional scene from different angles, the mobile electronic device 30 captures the motion data of the user's hand, and transmits it to the message transceiver module 122 in real time, through the extended scene The module 123 is converted into the real-time image output. At this time, the participant B can see the real-time image corresponding to its own hand in the stereoscopic scene in real time, and the extended context module 123 determines that the participant B is The motion data is, for example, judging the turning of the head or the movement when walking to generate the corresponding three-dimensional scene, or judging the movement of the hand to generate the real-time image corresponding to the hand.

The three-dimensional scene includes a toolbox 50, and the toolbox 50 is displayed in the keyword database 1212 and corresponds to more than one key point related to the learning course, and the more than one key point can be more than one English list or more than one Grammar sentence, the toolbox 50 can be reduced, expanded or moved in the stereoscopic scene through the real-time image presentation of the corresponding hand of the participant B. The participant B experiences the study When studying a course, if you suddenly encounter an unfamiliar word, you can turn your head to watch or open the toolbox 50 by using the real-time image of your hand, or click the play button of the toolbox 50 to listen to the pronunciation of one of the English lists, so that the participant can participate The end B will not interrupt the learning, which affects the learning experience and effectiveness, wherein the participating end B clicks on one or more of the key points of the toolbox 50, and the processing unit 1213 records and stores it.

First, one or more start buttons 51 appear in front of the participant B, and the start buttons 51 guide the participant B to perform one or more tasks in the learning course. After clicking each of the start buttons 51, the mobile electronic device 30 starts to Describe a story background of the learning course in English and describe a role of the participant B in the story background and each task that the role needs to complete, for example: a first start button 51A describes that the participant B is a A hunter who is lost in a deep mountain, the hunter needs to find a way out in the deep mountain; a second start button 51B indicates that the hunter can find a wise man in a pavilion, steal and exchange an apple to get a hint; a The third start key 51C prompts the hunter of the location of the apple, and the participant B performs the task after listening to each content played by the start key 51 .

When the participant B performs the task, the extended context module 123 presents the result corresponding to the learning course according to a gesture or an action displayed by the participant B. For example, when the participant B passes a bridge to an apple tree, The participating terminal B can perform an upwardly grabbing motion corresponding to the position of the apple according to the real-time image of the hand, and can see that the real-time image of the hand has obtained an apple.

The mobile electronic device 30 records the audio data of the participant B, and transmits the audio data to the processing unit 1213, and judges the test result of the audio data according to the scoring logic, for example, when the participant B finds the audio data When being wise, the prompt needs to be obtained through dialogue. At this time, the processing unit judges the test result of the sound data according to whether the pronunciation of the sound data is standard, whether the grammar is correct, or whether the keyword is mentioned.

The learning course preferably includes a down key 52 and a return key 53, so that the participant B can enter the next learning course or return according to the learning status.

10 Servers A master Part B Internet

Claims (5)

A virtual reality interactive self-learning system, which includes a server for one or more main control terminals and one or more participating terminals to use an electronic device and log in through an Internet, and the electronic device receives the server The command of the server is sent and an image is generated, and a motion data and a sound data of the participant are captured and sent to the server, wherein: the server includes: a personnel system, the personnel system accepts the participant to log in, and recording a test result of the participant in each of the learning courses, and scheduling more than one learning course suitable for the participant according to the test results; a teaching system comprising: a situational course module storing a plurality of the Learning courses, and one or more key points corresponding to each of the learning courses, the situational course module outputs the selected learning course and one or more key points, the situational course module includes a processing unit, and the processing unit stores the corresponding learning courses. A grading logic of the course, the processing unit grades the action data and the sound data of the participant in one of the learning courses according to the grading logic, generates the test result, and stores the test result in the personnel system ; a message sending and receiving module, the message sending and receiving module is responsible for transmitting the learning course and one or more of the key points output by the situational course module to the electronic device, and the electronic device generates the image corresponding to the learning course and one or more of the key points , and receive the action data and the sound data recorded by the electronic device; and an extended context module, which can combine the action data with the context module in real time, and combine the action of the participant The data is converted into a real-time image and sent to the electronic device through the message transceiver module, and the extended context module determines that the action data and the sound data of the participant end present results corresponding to one or more of the key points of the learning course; and Each of the participating terminals includes a head-mounted display, the head-mounted display can accommodate the electronic device and convert the image generated by the electronic device into a stereoscopic scene for delivery, wherein: after the learning course is converted into the stereoscopic scene for delivery , the three-dimensional scene includes a toolbox, the toolbox displays one or more relevant key points stored in the corresponding learning course, the extended situation module judges the action data of the participating terminal to generate the corresponding three-dimensional scene; and the server Including a management system, the management system stores all the personnel systems of the participating terminal, the management system only opens the authority to the main control terminal, and the main control terminal can check all the personnel systems through the management system and arrange the learning course; The main control terminal can edit the teaching system through the management system. According to the virtual reality interactive self-learning system according to claim 1, the personnel system includes a course unit, regularly gives the participant a test to measure the level of the participant, and schedules one or more learning courses suitable for the participant. According to the virtual reality interactive self-learning system described in claim 1 or 2, the participating terminal can select the learning course of interest in the teaching system, and inquire and review the test results in each of the learning courses, When the participant experiences the learning course, the toolbox can be reduced, expanded or moved by using the real-time image corresponding to a hand in the stereoscopic scene. According to the virtual reality interactive self-learning system described in claim 3, after the audio data recorded by the participant through the electronic device is transmitted to the message transceiver module, the teaching system stores the audio data in the processing unit via the processing unit. A grade unit in the personnel system, through which the participant can play back the sound data. According to the virtual reality interactive self-learning system according to claim 1 or 2, the participating terminal performs one of the learning course steps including: the participating terminal uses the electronic device to download and log in to the server; place the electronic device on the the head-mounted display, and then wear the head-mounted display on the head of the user of the participating terminal, so that the user of the participating terminal can view the three-dimensional scene; The participating terminal enters the personnel system and selects one of the learning courses; the selected one of the learning courses and the corresponding one or more key points are transmitted to the electronic device through the message transceiver module to start the learning course, During the process, the electronic device synchronously transmits the motion data and the sound data to the message transceiver module; the processing unit judges the test result of the current learning course for the motion data and the sound data according to the scoring logic, And the test result is stored in the personnel system, and the participant can turn his head to watch or use the action data to open the toolbox when experiencing the learning course.

Images