CN112071130A - Knowledge education system and education method based on VR technology - Google Patents
Knowledge education system and education method based on VR technology Download PDFInfo
- Publication number
- CN112071130A CN112071130A CN202010793038.4A CN202010793038A CN112071130A CN 112071130 A CN112071130 A CN 112071130A CN 202010793038 A CN202010793038 A CN 202010793038A CN 112071130 A CN112071130 A CN 112071130A
- Authority
- CN
- China
- Prior art keywords
- teaching
- wearer
- knowledge education
- scene
- evaluation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Computer Graphics (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Electrically Operated Instructional Devices (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a knowledge education system and an education method based on VR technology, wherein the system comprises: knowledge education VR scene making equipment is used for making knowledge education VR scenes; the VR equipment is used for providing the wearer with immersive learning, experience and interaction on the VR scene; the teaching monitoring equipment is used for monitoring data of the VR teaching process of the wearer and storing the monitored teaching data; and the teaching effect evaluation system is used for carrying out comprehensive analysis and evaluation on the VR teaching effect of the wearer based on the monitored teaching data to form a teaching evaluation report and output the teaching evaluation report. The knowledge education method based on the VR technology improves the immersion of knowledge education and improves the training effect of the knowledge education. The method can also quantitatively evaluate the knowledge education effect, and solves the problem that the training effect of the training object cannot be obtained in the traditional knowledge education training mode.
Description
Technical Field
The invention relates to the technical field of VR teaching, in particular to a knowledge education system and an education method based on VR technology.
Background
At present, the knowledge education training mode mainly comprises centralized training, collective learning, individual self-learning and living organization, practice and exercise, network training, communication and study and the like, but the on-site teaching mode needs to organize students together, so that the problems of difficult coordination of training time, high training cost and the like exist. Although the network training solves the problem that training time is difficult to coordinate, students are difficult to interactively communicate with lessees, and the training effect is not ideal. The practice training mode is more intuitive and more on-site, for example, through training education modes such as visiting museums on the spot, but the training cost is very high, and professional commentators are needed to explain on the spot, so that students are difficult to deeply know related knowledge through independent visiting modes, and the education effect is greatly reduced.
In addition, the existing knowledge education training mode generally adopts a manual evaluation method to evaluate the training effect, and the evaluation method is not scientific and objective and lacks of reference value.
Disclosure of Invention
The invention aims to provide a knowledge education system and an education method based on VR technology to solve the technical problems.
In order to achieve the purpose, the invention adopts the following technical scheme:
provided is a knowledge education system based on VR technique, including:
knowledge education VR scene making equipment is used for making knowledge education VR scenes;
the VR equipment is used for providing the wearer with immersive learning, experience and interaction on the VR scene;
the teaching monitoring equipment is in communication connection with the VR equipment and is used for monitoring data of the VR teaching process of the wearer and storing the monitored teaching data;
the teaching effect evaluation system is in communication connection with the teaching monitoring equipment and is used for carrying out comprehensive analysis and evaluation on the VR teaching effect of the wearer based on the monitored teaching data to form a teaching evaluation report and output the teaching evaluation report;
and the evaluation report receiving terminal is in communication connection with the teaching effect evaluation system and is used for receiving the teaching evaluation report related to the wearer for the specified personnel to check.
As a preferred aspect of the present invention, the knowledge education VR scenario creation device specifically includes:
the knowledge education VR venue space design module is used for providing designers with a space layout structure for designing the knowledge education VR venue according to the sorted materials;
the VR venue three-dimensional modeling module is connected with the knowledge education VR venue space design module and used for providing the designer with three-dimensional modeling for the designed venue space layout structure to form a three-dimensional model of the knowledge education VR venue;
the picture acquisition module is used for providing the designer with a data picture from a knowledge education picture database;
the picture processing module is connected with the picture acquisition module and is used for providing the designer with image processing on the data picture so as to meet the requirement of the mapping specification of the three-dimensional model;
the mapping module is respectively connected with the picture processing module and the VR venue three-dimensional modeling module and used for providing the designer with a mapping for the processed data picture to a designated display area in the three-dimensional model;
the exhibition text introduction embedding module is connected with the VR venue three-dimensional modeling module and used for providing the designer with predetermined exhibition text introduction to be embedded into a designated display area of a virtual exhibit to be associated in the three-dimensional model;
the exhibition article text introduction triggering control module is connected with the VR venue three-dimensional modeling module and used for providing the designer with a control mode for designing, triggering and displaying the exhibition article text introduction;
the explanation voice acquisition module is connected with a knowledge education explanation voice library and is used for providing the designer with the explanation voice acquired from the knowledge education explanation voice library;
an explanation voice embedding module which is respectively connected with the explanation voice obtaining module and the VR venue three-dimensional modeling module and is used for providing the designer with the explanation voice to be embedded into a specified exhibition hall plate in the three-dimensional model;
the explaining voice playing triggering control module is connected with the VR venue three-dimensional modeling module and used for providing the designer with a control mode for designing, triggering and playing the explaining voice;
the knowledge education video acquisition module is connected with a knowledge education video base and used for providing the designer with knowledge education videos acquired from the knowledge education video base;
a knowledge education video embedding module which is respectively connected with the knowledge education video acquisition module and the VR venue three-dimensional modeling module and is used for providing the designer with the knowledge education video to be embedded into a specified position in the three-dimensional model;
the knowledge education video triggering control module is connected with the VR venue three-dimensional modeling module and used for providing the designers with a control mode for designing, triggering and playing the knowledge education video;
and the VR scene generation module is used for optimizing and packaging the manufactured three-dimensional model and finally generating the VR scene.
As a preferred scheme of the present invention, the VR device is any one of a mobile phone VR, a VR all-in-one machine, and a host VR system.
As a preferred solution of the present invention, the host VR system includes a VR host, and a large-screen display device and a voice input/output device which are communicatively connected to the VR host, wherein the large-screen display device is configured to display an experience visual angle of the wearer in the VR scene to a viewer in a two-dimensional space, and the voice input/output device is configured to provide the wearer with a voice explanation in the VR experience and play the explained voice to the viewer through a speaker;
the host VR system further comprises a stereoscopic projection device which is in communication connection with the VR host and is used for projecting the experience visual angle of the wearer in the VR scene onto a display device in a three-dimensional space mode, and the audience carries out immersive knowledge education training by wearing 3D glasses to follow the walking route and the observation visual angle of the wearer in the VR scene.
As a preferred scheme of the present invention, the evaluation index for evaluating the VR teaching effect includes one or more of total experience duration of the wearer in the VR scene, a text display area, an explanation voice playing area, and a staying duration of a video playing area of the wearer in the VR scene, and times of triggering text display, explanation voice playing, and video playing of the wearer in the VR scene.
As a preferable aspect of the present invention, the teaching monitoring apparatus includes:
the timing module is used for accumulating the stay time of the wearer in each display area in the VR scene and the total experience duration in the VR scene to obtain index values of four evaluation indexes, namely 'the total experience duration of the wearer in the VR scene', 'the stay time duration in a text display area', 'the stay time duration in an explanation voice playing area' and 'the stay time duration in a video playing area';
and the interaction monitoring module is used for monitoring the education interaction condition of the wearer in the VR scene to obtain index values of three evaluation indexes, namely ' text display triggering frequency in the VR scene ', ' speech playing triggering frequency and ' video playing triggering frequency '.
As a preferable aspect of the present invention, the teaching effect evaluation system performs comprehensive analysis and evaluation on the VR teaching effect of the wearer by using the following formula (1):
in formula (1), G is used to represent the value of the score of the teaching effect evaluation system on the VR teaching effect of the wearer;
i is used for representing the evaluation index;
n represents the number of the evaluation indexes;
wia weight indicating the evaluation index;
gian index value representing the evaluation index.
The invention also provides a knowledge education method based on VR technology, which is realized by applying the knowledge education system and comprises the following steps:
manufacturing a knowledge education VR scene;
the wearer performs immersive learning, experiencing and interacting on the manufactured VR scene through VR equipment;
monitoring data of the VR teaching process of the wearer through teaching monitoring equipment and storing the monitored teaching data;
and comprehensively analyzing and evaluating the VR teaching effect of the wearer based on the monitored teaching data, forming a teaching evaluation report and outputting the teaching evaluation report to a designated evaluation report receiving terminal.
As a preferred scheme of the present invention, the evaluation index for evaluating the VR teaching effect includes any one or more of a total experience duration of the wearer in the VR scene, a text display area, an explanation voice playing area, a staying duration of a video playing area of the wearer in the VR scene, and a number of times that the wearer triggers text display, explanation voice playing, and video playing in the VR scene.
As a preferable aspect of the present invention, the VR teaching effect of the wearer is comprehensively analyzed and evaluated by the following formula (2):
in formula (2), G is used to represent the value of the score of the teaching effect evaluation system on the VR teaching effect of the wearer;
i is used for representing an evaluation index;
n represents the number of the evaluation indexes;
wia weight indicating the evaluation index;
gian index value representing the evaluation index.
The knowledge education VR scene is manufactured according to training requirements, and a training object wears VR equipment to carry out immersive learning, experience and interaction on the scene, so that the problem that the existing centralized training mode is difficult to coordinate training time is solved, and the education training effect is greatly improved. In addition, the method can also monitor the learning process of the training object in the VR scene, and then quantitatively evaluate the knowledge education effect of the training object according to the monitored data, so that the problem that the training effect of the training object cannot be obtained in the traditional knowledge education training mode is solved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be used in the embodiments of the present invention will be briefly described below. It is obvious that the drawings described below are only some embodiments of the invention, and that for a person skilled in the art, other drawings can be derived from them without inventive effort.
FIG. 1 is a schematic diagram of a system architecture of a knowledge education system based on VR technology according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of the internal structure of the knowledge education VR scene making equipment;
fig. 3 is a schematic structural diagram of the host VR system according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of the host VR system according to another embodiment of the present invention;
FIG. 5 is a schematic diagram of the internal structure of the teaching monitoring device;
fig. 6 is a flowchart illustrating a knowledge education method based on VR technology according to an embodiment of the present invention.
Detailed Description
The technical scheme of the invention is further explained by the specific implementation mode in combination with the attached drawings.
Wherein the showings are for the purpose of illustration only and are shown by way of illustration only and not in actual form, and are not to be construed as limiting the present patent; to better illustrate the embodiments of the present invention, some parts of the drawings may be omitted, enlarged or reduced, and do not represent the size of an actual product; it will be understood by those skilled in the art that certain well-known structures in the drawings and descriptions thereof may be omitted.
The same or similar reference numerals in the drawings of the embodiments of the present invention correspond to the same or similar components; in the description of the present invention, it should be understood that if the terms "upper", "lower", "left", "right", "inner", "outer", etc. are used for indicating the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, it is only for convenience of description and simplification of description, but it is not indicated or implied that the referred device or element must have a specific orientation, be constructed in a specific orientation and be operated, and therefore, the terms describing the positional relationship in the drawings are only used for illustrative purposes and are not to be construed as limitations of the present patent, and the specific meanings of the terms may be understood by those skilled in the art according to specific situations.
In the description of the present invention, unless otherwise explicitly specified or limited, the term "connected" or the like, if appearing to indicate a connection relationship between the components, is to be understood broadly, for example, as being fixed or detachable or integral; can be mechanically or electrically connected; they may be directly connected or indirectly connected through intervening media, or may be connected through one or more other components or may be in an interactive relationship with one another. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
Fig. 1 shows a schematic configuration of a knowledge education system based on VR technology. Referring to fig. 1, the system includes:
the knowledge education VR scene manufacturing equipment 1 is used for manufacturing a knowledge education VR scene;
the VR equipment 2 is used for providing the wearer with immersive learning, experience and interaction on the VR scene;
the teaching monitoring equipment 3 is in communication connection with the VR equipment 2 and is used for monitoring data of the VR teaching process of the wearer and storing the monitored teaching data;
the teaching effect evaluation system 4 is in communication connection with the teaching monitoring equipment 3 and is used for carrying out comprehensive analysis and evaluation on the VR teaching effect of the wearer based on the monitored teaching data, and forming and outputting a teaching evaluation report;
and the evaluation report receiving terminal 5 is in communication connection with the teaching effect evaluation system 4 and is used for receiving the teaching evaluation report of the associated wearer for the specified personnel to check.
In this embodiment, the VR scenario is a virtual environment for knowledge education. Unlike video, the picture at any point on the time axis can only show one corner of the whole environment, the virtual environment is full of the whole space, and the exhibits are distributed in the whole virtual space rather than in a certain direction. Experiential learning is the participation of individuals in physique, emotion and knowledge. In VR scene learning, visitors obtain direct experiences through visiting, operating, using exhibits in a venue, and obtain explanatory experiences through explanatory notes in the form of text, animation, video, etc. of the exhibits. Therefore, in order to enhance the interactive experience of visitors, teaching modes such as text explanation, video teaching and voice explanation related to knowledge education are embedded into the three-dimensional model in VR scene manufacturing, so that the education effect is improved.
Fig. 2 shows a schematic diagram of an internal structure of a knowledge education VR scenario creation apparatus. As shown in fig. 2, the knowledge education VR scenario creation device 1 specifically includes:
the knowledge education VR venue space design module 11 is used for providing designers with a space layout structure for designing the knowledge education VR venue according to the sorted materials; the materials refer to books, videos, character materials, display contents of a virtual hall, plate structures of an exhibition hall, placement positions of exhibits, visiting routes and the like related to knowledge education.
The VR venue three-dimensional modeling module 12 is connected with the knowledge education VR venue space design module 11 and is used for providing designers with three-dimensional modeling for the designed venue space layout structure to form a three-dimensional model of the knowledge education VR venue;
the picture acquisition module 13 is connected with the VR venue three-dimensional modeling module 12 and is used for providing designers with data pictures from a knowledge education picture database 100;
the picture processing module 14 is connected with the picture acquisition module 13 and is used for providing image processing for the designer to the data picture so as to meet the requirement of the mapping specification of the three-dimensional model;
the mapping module 15 is respectively connected with the picture processing module 14 and the VR venue three-dimensional modeling module, and is used for providing designers with a designated display area in the three-dimensional model for mapping the processed data pictures by a UV (mapping coordinate) technology;
the exhibition text introduction embedding module 16 is connected with the VR venue three-dimensional modeling module 12 and used for providing the designer with predetermined exhibition text introduction to be embedded into the designated display area of the virtual exhibit to be associated in the three-dimensional model;
the exhibition article text introduction triggering control module 17 is connected with the VR venue three-dimensional modeling module 12 and used for providing a designer with a control mode for designing, triggering and displaying the exhibition article text introduction; there are a variety of ways to trigger receipt of the exhibit text, such as when a visitor approaches the virtual exhibit for a threshold distance, the exhibit text presentation is automatically displayed at a designated display area next to the exhibit. Or a text introduction contact point is arranged near the virtual exhibit, and the visitor can display the text introduction of the exhibit after clicking the contact point through a controller provided by the VR device;
the explanation voice obtaining module 18 is connected with a knowledge education explanation voice library 200 and is used for providing designers with explanation voices obtained from the knowledge education explanation voice library;
the explanation voice embedding module 19 is respectively connected with the explanation voice obtaining module 18 and the VR venue three-dimensional modeling module 12, and is used for providing designers with explanation voices to be embedded into the appointed exhibition hall plate of the three-dimensional model;
the explanation voice playing triggering control module 20 is connected with the VR venue three-dimensional modeling module 12 and is used for providing designers with a control mode for designing triggering and playing explanation voice; in this embodiment, there may be many ways to trigger the speech interpretation, for example, the speech interpretation that can automatically trigger the response when the visitor enters a functional exhibition hall can be automatically interpreted. When the visitors enter the corresponding exhibition hall along the walking route, for example, the visitors enter the picture exhibition hall, the visitors automatically trigger the explanation of the voice, and the voice explanation is carried out on the pictures with great significance. To the explanation of showpiece, the characters show mode is more lively compared to the pronunciation explanation mode, so also can set up pronunciation explanation trigger point by the showpiece, and the visitor can click showpiece pronunciation explanation trigger point in order to trigger the pronunciation explanation to the showpiece through the controller of VR equipment by oneself. Of course, the voice explanation of the exhibit can be automatically played after the visitor approaches the exhibit and reaches the threshold distance.
The knowledge education video acquisition module 21 is connected with a knowledge education video base 300 and is used for providing designers with knowledge education videos acquired from the knowledge education video base;
the knowledge education video embedding module 22 is respectively connected with the knowledge education video obtaining module 21 and the VR venue three-dimensional modeling module 12 and is used for providing designers with knowledge education videos to be embedded into the designated positions of the three-dimensional models;
the knowledge education video triggering control module 23 is connected with the VR venue three-dimensional modeling module 12 and used for providing a control mode for designers to trigger and play the knowledge education video;
and the VR scene generation module 24 is connected with the VR venue three-dimensional modeling module 12 and used for optimizing and packaging the manufactured three-dimensional model, deleting unnecessary resources, checking and optimizing various settings, finally generating a VR scene, and outputting the VR scene into an exe executable file. And executing exe executable files of the VR scene by the VR equipment to enable the wearer to perform immersive learning, experience and interaction on the VR scene.
The following describes the types of VR devices to which the present embodiment is applicable:
in this embodiment, the VR device may be a mobile VR, VR all-in-one machine, or host VR system.
The mobile phone VR is a display device that operates a system with a smart phone as a content. The mobile phone VR is mainly a mobile phone shell consisting of two lenses, and the mobile phone is used as a carrier for calculation and display. The mobile phone VR has simple structure and low price, and the additional equipment of the VR is a Bluetooth handle, a touch pad and the like which are generally configured for controlling the mobile phone. The technical content of the VR equipment of the mobile phone is low, and the experience feeling and the interactivity are poor. Typical mobile phones VR on the market currently include Samsung Gear VR, Google Daydream View and the like.
The VR all-in-one machine is an independent device integrating a content operation platform and a display helmet, is a device directly arranging a high-end mobile phone in the helmet, is equivalent to a device with a processing system and a display screen, has the biggest advantage of convenient carrying, does not need to be inserted into the mobile phone, does not need an external computer or a game host, has sensors such as a gyroscope with direction induction, and can realize independent operation and input and output functions. Typical VR machines currently on the market are grand VR M2, Bosini X1, Pico Neo VR, etc.
The principle of the mobile phone VR and VR all-in-one machine is that visual stereo display and image rotation positioning are achieved by means of binocular parallax and a gyroscope, and interactive operation is achieved by continuously watching a hot area or buttons through visual points. In this way, the embedded pictures, videos, voice commentary and the like in the panoramic image can be opened or closed, or the embedded 360-sequence pictures can be activated to present the 3D object.
With a host VR system with a head mounted display and motion controller, immersion and interactivity is optimal and the head mounted wearer is able to get the best individual experience. However, the host VR system is expensive in overall cost because the helmet mounted display and the motion controller need to be connected with a high-performance PC host, each set of equipment can only be experienced by one person, a certain space is needed for operation, a general community or knowledge training education department is powerless to invest huge financial resources, equipment and space, and an independent host VR system is configured for each object to be trained.
Therefore, as a preferred solution to solve the problem of high use cost of the host VR system, as shown in fig. 3, the host VR system provided by the present invention includes a VR host 6, and a large-screen display device 7 and a voice input/output device 8 communicatively connected to the VR host 6, where the VR host 6 may be any one of existing HTC view, Oculus Rift or Sony PS VR, the large-screen display device 7 is configured to display an experience view angle of a VR helmet wearer in a VR scene to a viewer in a two-dimensional space form, and the voice input/output device 8 is configured to provide the wearer with a voice explanation in a VR experience, and play the explained voice to the viewer through a speaker.
The host VR system of VR host + large-screen display equipment + voice input/output equipment only needs a VR host to show for spectator through the experience visual angle with in the VR scene, has solved in the past that a host VR system can only supply an experience person to carry out the problem of interactive experience. However, since the large-screen display device only supports displaying the experience visual angle of the VR scene to the audience in a two-dimensional space form, the audience experiences the VR scene with a less intense immersion feeling, and the knowledge education effect is greatly reduced.
In order to solve the problem, the invention provides another host VR system, as shown in fig. 4, the host VR system comprises a VR host 6 and a stereo projection device 9 which is in communication with the VR host 6, the stereo projection device 9 is used for projecting the experience visual angle of the wearer in the VR scene onto a display device in a three-dimensional space form, and the audience carries out immersive knowledge education training by wearing 3D glasses to follow the walking route and the observation visual angle of the wearer in the VR scene.
The method for evaluating the knowledge education training effect of the invention is explained as follows:
the method adopts a quantitative evaluation mode to evaluate the knowledge education training effect of the wearer, the quantitative evaluation mode is more objective, scientific and fair, and evaluation basis can be provided for training organizers or related evaluation departments. In order to realize quantitative evaluation of knowledge education training effects, specific evaluation indexes are required to be determined firstly, and the evaluation indexes provided by the invention comprise the total experience time of a wearer in a VR scene, the stay time of the wearer in a character display area in the VR scene, the stay time of the wearer in an explanation voice playing area and a video playing area, and the times of triggering character display, explanation voice playing and video playing of the wearer in the VR scene.
According to the method, the experience behavior of the wearer in the VR scene is monitored through the teaching monitoring equipment, so that the index value of each evaluation index is obtained. Specifically, referring to fig. 5, the teaching monitoring device 3 includes:
the timing module 31 is configured to accumulate the staying time of the wearer in each display area in the VR scene and the total experience duration in the VR scene to obtain index values of four evaluation indexes, namely, "the total experience duration of the wearer in the VR scene", "the staying duration in the text display area", "the staying duration in the speech playing area", "the staying duration in the video playing area", and the like;
the interaction monitoring module 32 is configured to monitor an educational interaction situation of the wearer in the VR scene, and obtain index values of three evaluation indexes, namely "number of times of triggering text display in the VR scene", "number of times of triggering and explaining voice playing", and "number of times of triggering video playing".
The teaching effect evaluation system provided by the invention comprehensively analyzes and evaluates the VR teaching effect of a wearer by the following formula (1):
in the formula (1), G is used for expressing the value of the credit rating of the teaching effect evaluation system on the VR teaching effect of the wearer;
i is used for representing an evaluation index;
n represents the number of evaluation indexes;
wia weight indicating an evaluation index;
gian index value representing an evaluation index.
The invention also provides a knowledge education method based on VR technology, which is realized by applying the knowledge education system, as shown in figure 6, the knowledge education method comprises the following steps:
step S1, making a knowledge education VR scene;
step S2, the wearer performs immersive learning, experience and interaction on the VR scene through VR equipment;
step S3, monitoring the VR teaching process of the wearer through teaching monitoring equipment and storing the monitored teaching data;
and step S4, comprehensively analyzing and evaluating the VR teaching effect of the wearer based on the monitored teaching data, forming a teaching evaluation report and outputting the teaching evaluation report to a designated evaluation report receiving terminal.
In the knowledge education method, the evaluation indexes for evaluating the VR teaching effect comprise the total experience time of the wearer in the VR scene, the stay time of the wearer in a character display area in the VR scene, the stay time of the wearer in an explanation voice playing area and a video playing area, and the times of triggering character display, explanation voice playing and video playing of the wearer in the VR scene.
The teaching monitoring equipment carries out data monitoring through the VR experience process to the person of wearing in order to obtain the index value of each evaluation index. The detailed description of the specific process for obtaining the index value is provided in the knowledge education system, and will not be repeated herein.
In the knowledge education method, comprehensive analysis and evaluation are performed on VR teaching effects of a wearer through the following formula (2):
in the formula (1), G is used for expressing the value of the credit rating of the teaching effect evaluation system on the VR teaching effect of the wearer;
i is used for representing an evaluation index;
n represents the number of evaluation indexes;
wia weight indicating an evaluation index;
gian index value representing an evaluation index.
In conclusion, the immersion of knowledge education is improved based on the VR technology, and the training effect of the knowledge education is improved. The method can also quantitatively evaluate the knowledge education effect, and solves the problem that the training effect of the training object cannot be obtained in the traditional knowledge education training mode.
It should be understood that the above-described embodiments are merely preferred embodiments of the invention and the technical principles applied thereto. It will be understood by those skilled in the art that various modifications, equivalents, changes, and the like can be made to the present invention. However, such variations are within the scope of the invention as long as they do not depart from the spirit of the invention. In addition, certain terms used in the specification and claims of the present application are not limiting, but are used merely for convenience of description.
Claims (10)
1. A knowledge education system based on VR technology, comprising:
knowledge education VR scene making equipment is used for making knowledge education VR scenes;
the VR equipment is used for providing the wearer with immersive learning, experience and interaction on the VR scene;
the teaching monitoring equipment is in communication connection with the VR equipment and is used for monitoring data of the VR teaching process of the wearer and storing the monitored teaching data;
the teaching effect evaluation system is in communication connection with the teaching monitoring equipment and is used for carrying out comprehensive analysis and evaluation on the VR teaching effect of the wearer based on the monitored teaching data to form a teaching evaluation report and output the teaching evaluation report;
and the evaluation report receiving terminal is in communication connection with the teaching effect evaluation system and is used for receiving the teaching evaluation report related to the wearer for the specified personnel to check.
2. The VR technology based knowledge education system of claim 1, wherein the knowledge education VR scenario creation facility specifically includes:
the knowledge education VR venue space design module is used for providing designers with a space layout structure for designing the knowledge education VR venue according to the sorted materials;
the VR venue three-dimensional modeling module is connected with the knowledge education VR venue space design module and used for providing the designer with three-dimensional modeling for the designed venue space layout structure to form a three-dimensional model of the knowledge education VR venue;
the picture acquisition module is used for providing the designer with a data picture from a knowledge education picture database;
the picture processing module is connected with the picture acquisition module and is used for providing the designer with image processing on the data picture so as to meet the requirement of the mapping specification of the three-dimensional model;
the mapping module is respectively connected with the picture processing module and the VR venue three-dimensional modeling module and used for providing the designer with a mapping for the processed data picture to a designated display area in the three-dimensional model;
the exhibition text introduction embedding module is connected with the VR venue three-dimensional modeling module and used for providing the designer with predetermined exhibition text introduction to be embedded into a designated display area of a virtual exhibit to be associated in the three-dimensional model;
the exhibition article text introduction triggering control module is connected with the VR venue three-dimensional modeling module and used for providing the designer with a control mode for designing, triggering and displaying the exhibition article text introduction;
the explanation voice acquisition module is connected with a knowledge education explanation voice library and is used for providing the designer with the explanation voice acquired from the knowledge education explanation voice library;
an explanation voice embedding module which is respectively connected with the explanation voice obtaining module and the VR venue three-dimensional modeling module and is used for providing the designer with the explanation voice to be embedded into a specified exhibition hall plate in the three-dimensional model;
the explaining voice playing triggering control module is connected with the VR venue three-dimensional modeling module and used for providing the designer with a control mode for designing, triggering and playing the explaining voice;
the knowledge education video acquisition module is connected with a knowledge education video base and used for providing the designer with knowledge education videos acquired from the knowledge education video base;
a knowledge education video embedding module which is respectively connected with the knowledge education video acquisition module and the VR venue three-dimensional modeling module and is used for providing the designer with the knowledge education video to be embedded into a specified position in the three-dimensional model;
the knowledge education video triggering control module is connected with the VR venue three-dimensional modeling module and used for providing the designers with a control mode for designing, triggering and playing the knowledge education video;
and the VR scene generation module is connected with the VR venue three-dimensional modeling module and used for optimizing and packaging the manufactured three-dimensional model and finally generating the VR scene.
3. The VR technology based knowledge education system of claim 1, wherein the VR device is any one of a cell phone VR, a VR all-in-one machine, and a host VR system.
4. The VR technology based knowledge education system of claim 3, wherein the host VR system includes a VR host and a large screen display device and a voice input output device communicatively connected to the VR host, the large screen display device is configured to display an experience perspective of the wearer in the VR scene to a viewer in a two dimensional spatial form, and the voice input output device is configured to provide the wearer with a voice explanation in a VR experience and play the explained voice to the viewer through a speaker;
the host VR system further comprises a stereoscopic projection device which is in communication connection with the VR host and is used for projecting the experience visual angle of the wearer in the VR scene onto a display device in a three-dimensional space mode, and the audience carries out immersive knowledge education training by wearing 3D glasses to follow the walking route and the observation visual angle of the wearer in the VR scene.
5. The VR technology based knowledge education system of claim 1 wherein evaluation metrics for evaluating VR teaching effects include any one or more of a total length of experience of the wearer in the VR scene, a text presentation area, a speech presentation area, a dwell length of a video presentation area of the wearer in the VR scene, and a number of times the wearer triggers text presentation, speech presentation, and video presentation in the VR scene.
6. The VR technology based knowledge education system of claim 5, wherein the instructional monitoring device includes:
the timing module is used for accumulating the stay time of the wearer in each display area in the VR scene and the total experience duration in the VR scene to obtain index values of four evaluation indexes, namely 'the total experience duration of the wearer in the VR scene', 'the stay time duration in a text display area', 'the stay time duration in an explanation voice playing area' and 'the stay time duration in a video playing area';
and the interaction monitoring module is used for monitoring the education interaction condition of the wearer in the VR scene to obtain index values of three evaluation indexes, namely ' text display triggering frequency in the VR scene ', ' speech playing triggering frequency and ' video playing triggering frequency '.
7. The VR technology based knowledge education system of claim 6, wherein the teaching effect evaluation system performs comprehensive analysis evaluation on the VR teaching effect of the wearer through the following formula (1):
in formula (1), G is used to represent the value of the score of the teaching effect evaluation system on the VR teaching effect of the wearer;
i is used for representing the evaluation index;
n represents the number of the evaluation indexes;
wia weight indicating the evaluation index;
gian index value representing the evaluation index.
8. A knowledge education method based on VR technology, which is realized by applying the knowledge education system as claimed in any one of claims 1-7, and comprises the following steps:
manufacturing a knowledge education VR scene;
the wearer performs immersive learning, experiencing and interacting on the manufactured VR scene through VR equipment;
monitoring data of the VR teaching process of the wearer through teaching monitoring equipment and storing the monitored teaching data;
and comprehensively analyzing and evaluating the VR teaching effect of the wearer based on the monitored teaching data, forming a teaching evaluation report and outputting the teaching evaluation report to a designated evaluation report receiving terminal.
9. The VR technology based knowledge education method of claim 8 wherein the evaluation metrics for evaluating VR teaching effects include any one or more of a total length of experience of the wearer in the VR scene, a text presentation area, a speech presentation area, a dwell time in a video presentation area of the wearer in the VR scene, and a number of times the wearer triggered text presentation, speech presentation, and video presentation in the VR scene.
10. The VR technology based knowledge education method of claim 9, wherein the comprehensive analysis evaluation of the wearer's VR teaching effects is performed by the following formula (2):
in formula (2), G is used to represent the value of the score of the teaching effect evaluation system on the VR teaching effect of the wearer;
i is used for representing an evaluation index;
n represents the number of the evaluation indexes;
wia weight indicating the evaluation index;
gian index value representing the evaluation index.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010793038.4A CN112071130A (en) | 2020-08-07 | 2020-08-07 | Knowledge education system and education method based on VR technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010793038.4A CN112071130A (en) | 2020-08-07 | 2020-08-07 | Knowledge education system and education method based on VR technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112071130A true CN112071130A (en) | 2020-12-11 |
Family
ID=73660970
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010793038.4A Pending CN112071130A (en) | 2020-08-07 | 2020-08-07 | Knowledge education system and education method based on VR technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112071130A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112596608A (en) * | 2020-12-22 | 2021-04-02 | 国投信开水环境投资有限公司 | Water environment protection propaganda education system and method based on VR technology |
| CN113095975A (en) * | 2021-04-27 | 2021-07-09 | 视伴科技(北京)有限公司 | Method and device for training volunteers |
| CN116757890A (en) * | 2023-08-21 | 2023-09-15 | 北京天平地成信息技术服务有限公司 | VR-based on-line virtual education method, system, device, and readable storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105117749A (en) * | 2015-08-19 | 2015-12-02 | 苏州市新瑞奇节电科技有限公司 | Introduction method based on RFID |
| CN107122051A (en) * | 2017-04-26 | 2017-09-01 | 北京大生在线科技有限公司 | Build the method and system of three-dimensional teaching environment |
| CN107765859A (en) * | 2017-11-09 | 2018-03-06 | 温州大学 | A kind of training system and method based on VR virtual classrooms |
| CN108416708A (en) * | 2018-02-08 | 2018-08-17 | 佛山市三盟新能源有限公司 | A kind of design method of primary school education multimedia interactive teaching system |
| CN108536573A (en) * | 2018-04-17 | 2018-09-14 | 中山市华南理工大学现代产业技术研究院 | A kind of VR application performances and the method for user behavior monitoring |
| CN108877371A (en) * | 2018-06-29 | 2018-11-23 | 温州大学 | A kind of VR teaching in VR classroom training system and implementation method |
| CN109727167A (en) * | 2019-01-07 | 2019-05-07 | 北京汉博信息技术有限公司 | A kind of teaching auxiliary system |
| CN110910799A (en) * | 2019-11-25 | 2020-03-24 | 深圳市飞宇通视讯工程有限公司 | Product exhibition display voice explanation system |
| CN111325643A (en) * | 2020-02-17 | 2020-06-23 | 合肥工业大学 | Admire class teaching capability guiding method |
| CN111477131A (en) * | 2020-05-22 | 2020-07-31 | 上海海事大学 | Intelligent exhibition hall voice broadcasting device and broadcasting method thereof |
-
2020
- 2020-08-07 CN CN202010793038.4A patent/CN112071130A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105117749A (en) * | 2015-08-19 | 2015-12-02 | 苏州市新瑞奇节电科技有限公司 | Introduction method based on RFID |
| CN107122051A (en) * | 2017-04-26 | 2017-09-01 | 北京大生在线科技有限公司 | Build the method and system of three-dimensional teaching environment |
| CN107765859A (en) * | 2017-11-09 | 2018-03-06 | 温州大学 | A kind of training system and method based on VR virtual classrooms |
| CN108416708A (en) * | 2018-02-08 | 2018-08-17 | 佛山市三盟新能源有限公司 | A kind of design method of primary school education multimedia interactive teaching system |
| CN108536573A (en) * | 2018-04-17 | 2018-09-14 | 中山市华南理工大学现代产业技术研究院 | A kind of VR application performances and the method for user behavior monitoring |
| CN108877371A (en) * | 2018-06-29 | 2018-11-23 | 温州大学 | A kind of VR teaching in VR classroom training system and implementation method |
| CN109727167A (en) * | 2019-01-07 | 2019-05-07 | 北京汉博信息技术有限公司 | A kind of teaching auxiliary system |
| CN110910799A (en) * | 2019-11-25 | 2020-03-24 | 深圳市飞宇通视讯工程有限公司 | Product exhibition display voice explanation system |
| CN111325643A (en) * | 2020-02-17 | 2020-06-23 | 合肥工业大学 | Admire class teaching capability guiding method |
| CN111477131A (en) * | 2020-05-22 | 2020-07-31 | 上海海事大学 | Intelligent exhibition hall voice broadcasting device and broadcasting method thereof |
Non-Patent Citations (1)
| Title |
|---|
| 产业成熟度编研组: "《产业成熟度评价方法与应用》", 30 November 2017 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112596608A (en) * | 2020-12-22 | 2021-04-02 | 国投信开水环境投资有限公司 | Water environment protection propaganda education system and method based on VR technology |
| CN113095975A (en) * | 2021-04-27 | 2021-07-09 | 视伴科技(北京)有限公司 | Method and device for training volunteers |
| CN116757890A (en) * | 2023-08-21 | 2023-09-15 | 北京天平地成信息技术服务有限公司 | VR-based on-line virtual education method, system, device, and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Elmqaddem | Augmented reality and virtual reality in education. Myth or reality? | |
| Park et al. | A metaverse: Taxonomy, components, applications, and open challenges | |
| Hammady et al. | Design and development of a spatial mixed reality touring guide to the Egyptian museum | |
| CN112071130A (en) | Knowledge education system and education method based on VR technology | |
| CN108389249B (en) | Multi-compatibility VR/AR space classroom and construction method thereof | |
| Tacgin | Virtual and augmented reality: an educational handbook | |
| Yin | An artificial intelligent virtual reality interactive model for distance education | |
| Kirner et al. | Using augmented reality artifacts in education and cognitive rehabilitation | |
| CN110297584A (en) | The immersion interaction classroom CAVE towards children education | |
| Dupont et al. | Exploring the appropriateness of different immersive environments in the context of an innovation process for smart-cities | |
| Kounlaxay et al. | Design of Learning Media in Mixed Reality for Lao Education. | |
| KR20180080012A (en) | The apparatus and method of musical contents creation and sharing system using social network service | |
| CN110850976A (en) | Virtual reality projection and retrieval system based on environment perception | |
| Shanmugam et al. | Research opportunities on virtual reality and augmented reality: a survey | |
| Clark | Extended reality in informal learning environments | |
| Sekhar et al. | Future Reality is Immersive Reality | |
| Vardhan et al. | AR Museum: A Virtual Museum using Marker less Augmented Reality System for Mobile Devices | |
| Li et al. | Application of virtual reality and augmented reality technology in Teaching | |
| CN112037090B (en) | Knowledge education system based on VR technology and 6DOF gesture tracking | |
| Pfeiffer et al. | Virtual prototyping of mixed reality interfaces with internet of things (IoT) connectivity | |
| Huang | Virtual reality/augmented reality technology: the next chapter of human-computer interaction | |
| CN112037090A (en) | Knowledge education system based on VR technology and 6DOF posture tracking | |
| Saghir | Utilization of viewer location based projection effects on ODV video display in CAVE like environments | |
| Zhang et al. | Virtual Museum Scene Design Based on VRAR Realistic Interaction under PMC Artificial Intelligence Model | |
| CN211264542U (en) | Teaching support system based on high-speed communication technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201211 |
|
| RJ01 | Rejection of invention patent application after publication |