CN112783320A - Immersive virtual reality case teaching display method and system - Google Patents
Immersive virtual reality case teaching display method and system Download PDFInfo
- Publication number
- CN112783320A CN112783320A CN202011132661.1A CN202011132661A CN112783320A CN 112783320 A CN112783320 A CN 112783320A CN 202011132661 A CN202011132661 A CN 202011132661A CN 112783320 A CN112783320 A CN 112783320A
- Authority
- CN
- China
- Prior art keywords
- case
- virtual
- virtual reality
- teaching
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Human Computer Interaction (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides an immersive virtual reality case teaching display method and system, wherein the method comprises the following steps: constructing a case simulation scene by using a 3D modeling technology according to the acquired text information of the teaching case; wherein the case simulation scenario comprises: virtual terrain, virtual buildings, virtual environments, virtual characters, virtual objects, virtual weather, virtual lighting; the 3D modeling technique includes: 3DS MAX, Unity 3D; rendering and testing the case simulation scene; wherein the testing comprises: functional test, performance test and regression test; and releasing the case simulation scenes meeting the test conditions on line. The invention provides a virtual reality-based case teaching system, which utilizes a virtual reality technology to create a virtual scene by using 3D modeling to restore the situation in a case, helps a user to understand the case, improves the case analysis efficiency and further improves the course teaching quality.
Description
Technical Field
The invention relates to the technical field of virtual reality, in particular to an immersive virtual reality case teaching display method and system.
Background
With the development of computer and network technology, the transmission of data information is more and more convenient, and great changes are brought to the teaching and technical training modes, so that the teaching and training are not limited by time and places any more. Immersive Learning (Immersive Learning) refers to providing a near-real training environment for trainees through Virtual Reality (VR) technology, and by means of a Virtual working environment, trainees can improve skills through high participation in interaction and training.
The current research and application of virtual reality technology mainly focuses on the fields of games, education and audio and video, and immersion experience is mainly provided for users, so that the real feeling of the users in a virtual environment is enhanced. At present, education virtual reality is applied in medical or science and technology experiments, emergency risk avoiding training and cultural tourism. The virtual reality assisted case teaching is lacked, and the application of the use case teaching effect is improved.
The case teaching method is guided by actual case problems and guided by problems, and students learn by finding problems from cases, analyzing the problems and solving the problems. The aim is to arouse the learning interest of students and train the learning ability of the students. The case teaching method focuses on enabling students to learn and communicate with each other in a study by means of a learning group until an optimal problem solution is generated. The case teaching method is characterized in that real problems are applied to teaching, and students can feel the problems in the real situation as much as possible.
In the early stage of case teaching, cases are described only by using characters, students need to read a large number of characters and imagine the situations of the cases in the mind to help understanding, and when the cases are too long, the contents are difficult to remember, and the experience of reading the cases is poor. With the development of digitization, some researches develop that cases are described and presented by using pictures, audio or videos, and students do not need to take advantage of the empty imagination of case situations through intuitive images and sounds, so that the comprehension capability of the cases is enhanced. However, a lot of time is consumed for viewing a large amount of image data, the motivation for mobilizing students to learn autonomously is very limited, and students easily lose interest in the middle of the course, so it is necessary to develop a teaching method capable of continuously attracting the attention of students and maintaining the interest of learning, so as to enhance the course teaching effect. For case learning, students can be in real case scenes, wherein the scenes comprise real environment elements such as time, place, people and buildings of case occurrence, and the purpose of dialysis case is achieved by participating in events in the scenes and communicating with related people.
Disclosure of Invention
The invention provides an immersive virtual reality case teaching display method and system, and solves the problems.
An embodiment of the invention provides an immersive virtual reality case teaching display method, which comprises the following steps:
constructing a case simulation scene by using a 3D modeling technology according to the acquired text information of the teaching case; wherein the case simulation scenario comprises: virtual terrain, virtual buildings, virtual environments, virtual characters, virtual objects, virtual weather, virtual lighting; the 3D modeling technique includes: 3DS MAX, Unity 3D;
rendering and testing the case simulation scene; wherein the testing comprises: functional test, performance test and regression test;
and releasing the case simulation scenes meeting the test conditions on line.
Further, after the case simulation scene is constructed according to the acquired text information of the teaching case, the method further includes:
collecting configuration audio of a case simulation scene;
and binding the configuration audio with the virtual character through Unity3D, and setting a script according to the conversation content.
Further, after the case simulation scenario meeting the test condition is released online, the method further includes:
the method comprises the steps of utilizing head-mounted virtual reality equipment, combining a head loudspeaker audio technology, supporting Doppler effect model-based, combining a double-ear positioning audio technology, adopting a linear volume-distance attenuation method to represent attenuation of objects and other background sound sources in a VR learning environment, and performing space rendering suitable for different object sounds and background sound effects in a VR scene.
Further, after the case simulation scenario meeting the test condition is released online, the method further includes:
utilize wear-type virtual reality equipment, combine the head tracking technique, video picture and the synchronous update of sound when supporting the removal of student's head in the VR learning environment, look the multichannel of sense of hearing and fuse the show, wherein, wear-type virtual reality equipment includes: HTC VIVE, Oculus.
An embodiment of the present invention provides an immersive virtual reality case teaching display system, including:
the case simulation scene construction module is used for constructing a case simulation scene by using a 3D modeling technology according to the acquired text information of the teaching case; wherein the case simulation scenario comprises: virtual terrain, virtual buildings, virtual environments, virtual characters, virtual objects, virtual weather, virtual lighting; the 3D modeling technique includes: 3DS MAX, Unity 3D;
the test module is used for rendering and testing the case simulation scene; wherein the testing comprises: functional test, performance test and regression test;
and the release module is used for releasing the case simulation scenes meeting the test conditions on line.
Further, the immersive virtual reality case teaching display system further includes:
the audio acquisition module is used for acquiring configuration audio of a case simulation scene;
and the audio fusion module is used for binding the configuration audio with the virtual character through Unity3D and setting a script according to the conversation content.
Further, the immersive virtual reality case teaching display system further includes:
the audio-visual combined space rendering module is used for utilizing the head-mounted virtual reality equipment, combining a head loudspeaker audio technology, supporting a Doppler effect model, combining a double-ear positioning audio technology, and representing attenuation of objects and other background sound sources in a VR learning environment by adopting a linear volume-distance attenuation method, so that a space rendering mode suitable for different object sounds and background sound effects in a VR scene is realized.
Further, the immersive virtual reality case teaching display system further includes:
the synchronous update module of audio frequency and video for utilize wear-type virtual reality equipment, combine the head tracking technique, video picture and the synchronous update of sound when supporting in the VR learning environment student head and removing, look the multichannel of sense of hearing and fuse the show, wherein, wear-type virtual reality equipment includes: HTC VIVE, Oculus.
An embodiment of the present invention further provides an electronic device, which includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, and when the processor executes the computer program, the processor implements any one of the immersive virtual reality case teaching display methods.
An embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, where when the computer program runs, the computer-readable storage medium is controlled to execute any one of the immersive virtual reality case teaching display methods.
Compared with the prior art, the embodiment of the invention has the beneficial effects that:
the invention provides an immersive virtual reality case teaching display method and system, wherein the method comprises the following steps: constructing a case simulation scene by using a 3D modeling technology according to the acquired text information of the teaching case; wherein the case simulation scenario comprises: virtual terrain, virtual buildings, virtual environments, virtual characters, virtual objects, virtual weather, virtual lighting; the 3D modeling technique includes: 3DS MAX, Unity 3D; rendering and testing the case simulation scene; wherein the testing comprises: functional test, performance test and regression test; and releasing the case simulation scenes meeting the test conditions on line. The invention provides a virtual reality-based case teaching system, which utilizes a virtual reality technology to create a virtual scene by using 3D modeling to restore the situation in a case, helps a user to understand the case, improves the case analysis efficiency and further improves the course teaching quality.
Drawings
In order to more clearly illustrate the technical solution of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a case teaching display method of immersive virtual reality according to an embodiment of the present invention;
fig. 2 is a flowchart of a case teaching display method of immersive virtual reality according to another embodiment of the present invention;
fig. 3 is a flowchart of a case teaching display method of immersive virtual reality according to another embodiment of the present invention;
fig. 4 is a flowchart of a case teaching display method of immersive virtual reality according to another embodiment of the present invention;
fig. 5 is a structural framework diagram of a case teaching presentation system for immersive virtual reality according to an embodiment of the present invention;
fig. 6 is a flowchart of an implementation method of an immersive virtual reality case teaching display system according to an embodiment of the present invention;
fig. 7 is a flowchart of a specific implementation method of an immersive virtual reality case teaching display system according to an embodiment of the present invention;
fig. 8 is a schematic diagram of content creation of an immersive virtual reality case teaching display system according to an embodiment of the present invention;
fig. 9 is a functional diagram of an immersive virtual reality case teaching display system according to an embodiment of the present invention;
fig. 10 is a block diagram of an immersive virtual reality case teaching presentation system according to an embodiment of the present invention;
fig. 11 is a block diagram of an immersive virtual reality case teaching presentation system according to another embodiment of the present invention;
fig. 12 is a block diagram of an immersive virtual reality case teaching presentation system according to another embodiment of the present invention;
fig. 13 is a block diagram of a case teaching presentation system for immersive virtual reality according to another embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be understood that the step numbers used herein are for convenience of description only and are not intended as limitations on the order in which the steps are performed.
It is to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the specification of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
The terms "comprises" and "comprising" indicate the presence of the described features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
The term "and/or" refers to and includes any and all possible combinations of one or more of the associated listed items.
A first aspect.
The case teaching method is guided by actual case problems and guided by problems, and students learn by finding problems from cases, analyzing the problems and solving the problems. The aim is to arouse the learning interest of students and train the learning ability of the students. The case teaching method focuses on enabling students to learn and communicate with each other in a study by means of a learning group until an optimal problem solution is generated. The case teaching method is characterized in that real problems are applied to teaching, and students can feel the problems in the real situation as much as possible.
The current research and application of virtual reality technology mainly focuses on the fields of games, education and audio and video, and immersion experience is mainly provided for users, so that the real feeling of the users in a virtual environment is enhanced. At present, education virtual reality is applied in medical or science and technology experiments, emergency risk avoiding training and cultural tourism. The virtual reality assisted case teaching is lacked, and the application of the use case teaching effect is improved.
Referring to fig. 1-4, an embodiment of the present invention provides an immersive virtual reality case teaching display method, including:
s10, constructing a case simulation scene by using a 3D modeling technology according to the acquired text information of the teaching case; wherein the case simulation scenario comprises: virtual terrain, virtual buildings, virtual environments, virtual characters, virtual objects, virtual weather, virtual lighting; the 3D modeling technique includes: 3DS MAX, Unity 3D.
In one embodiment, virtual reality teaching case content creation includes case virtual scene creation, case virtual character and virtual object creation, case text content creation, case voice content recording, and case interaction function development. The case text content creation is mainly based on text content and combined with a virtual scene for experience and understanding. The case teaching content creation is mainly performed by characters, and virtual scenes are made according to the content described by the characters, wherein the virtual scenes comprise virtual terrains, virtual buildings, virtual environments, virtual characters and virtual objects. The virtual character and the virtual object are interacted, the surrounding virtual environment is felt, the purpose of understanding the text content is achieved, and the course content is combined for displaying and teaching. Places, people, buildings, environments and objects appearing in the text content of the teaching cases can be made into 3D models. The virtual scene is a 3D model manufactured by using 3D modeling software, and comprises a 3D terrain model, a 3D building model, a 3D animal model, a 3D plant model, a 3D character model and a 3D object model. Head-mounted virtual reality equipment such as HTC VIVE and Oculus is utilized to enter a constructed virtual scene, and the virtual scene is observed and sensed through a virtual reality helmet display. Utilize VR treadmill equipment, connect the high performance computer that the virtual reality helmet corresponds, realize the boundless walking in the virtual scene. The virtual character and the virtual object are clicked or touched by using a handle controller held in the hand in reality. Students can feel the surrounding virtual environment and interact with virtual characters and virtual objects to achieve the purpose of understanding the text content, and the students can show and teach by combining the course content.
S20, rendering and testing the case simulation scene; wherein the testing comprises: functional test, performance test and regression test.
In one embodiment, the virtual reality case teaching system tests include a function test, a performance test, and a regression test. The system test is to test the integrity of the system function, test the stability of the system performance, test the bug existing in the system and repair the bug.
And S30, distributing the case simulation scenes meeting the test conditions on line.
In one embodiment, a virtual reality case tutorial system is published, the case tutorial system being published on the internet. The user experiences. The case teaching system is released in the Internet and mainly released in a mainstream VR application platform for providing download service. The user experiences that in the teaching course, the student uses the virtual reality case teaching system, combines the text content that the course provided, improves the teaching quality.
In a specific embodiment, after the S10, constructing a case simulation scene according to the obtained text information of the teaching case, the method further includes:
and S11, acquiring configuration audio of the case simulation scene.
And S12, binding the configuration audio with the virtual character through Unity3D, and setting a script according to the conversation content.
In one embodiment, the case voice content is recorded as audio by the author in accordance with the case content using a voice recording device. Case voice content is recorded as the author records audio as the case content using a voice recording device. The case voice content is recorded to enable an author to edit and optimize the sound and sound effects of the recorded audio. A user can hear the sound of the virtual character through a loudspeaker on the VR helmet, the sound is recorded by a real person in advance, the sound is edited into an MP4 audio file, the audio file is imported into the Unity3D, the file is bound with the corresponding virtual character, and a script is set according to conversation content. The user can use the VR handle controller to control the playing of the conversation content of the virtual character, so that the effect of conversation with the virtual character is achieved. In a virtual scene, a user may touch a virtual object using the VR handle controller, pick up and drop the virtual object using buttons on the VR handle controller
In a specific embodiment, after the S30, publishing the case simulation scenario meeting the test condition online, the method further includes:
s40, using the head-mounted virtual reality equipment, combining a head loudspeaker audio technology, supporting Doppler effect model-based, combining a double-ear positioning audio technology, adopting a linear volume-distance attenuation method to represent attenuation of objects and other background sound sources in a VR learning environment, and performing space rendering suitable for different object sounds and background sound effects in a VR scene.
In a specific embodiment, a head-mounted virtual reality device is utilized, a head speaker audio technology is combined, a model based on a doppler effect is supported, a binaural localization audio technology is combined, attenuation of a learning object and a background sound source is expressed by a linear volume-distance attenuation method, and a spatial rendering mode suitable for different object sounds and background sound effects in a VR scene is realized. Specifically, the method comprises the following steps:
and (4) simulating multiple sound sources. According to dynamic change parameters such as position, direction, attenuation and Doppler effect, static and dynamic point sound sources of corresponding objects and background sound effects without parameters such as position and speed are simulated in the VR learning environment.
And mixing multiple sound sources. In order to simulate the sound production of objects (such as animals and plants) in a real field environment, a three-dimensional audio processing mode is adopted, sound data of the objects are acquired by really acquiring sample sound or downloading the sound data from an existing audio library, standard audio files are generated by audio editing processing software, and then frequency spectrums of the sound of different objects are fused with each other to generate the required multi-track VR audio.
A sound attenuation effect representation. The sound volume decreases as the distance from the center of the learner's head to the sound source increases.
And (4) positioning double ears. The method comprises the following steps of utilizing head-mounted virtual reality equipment and combining a head loudspeaker audio technology to support the determination of horizontal, front-back and vertical directions of sound in a VR environment based on parameters such as frequency, phase and amplitude of a sound source, and completing the direction positioning of the sound source; and determining attributes such as motion visual difference, loudness, initial time delay, Doppler effect and reverberation equidistance according to attributes influencing sound propagation such as distance, position and terrain environment, calculating parameters such as distance, speed and direction of the sound source relative to learners in a VR learning environment in real time by using a head-related transfer function according to the direction and distance of the sound source, and processing signals of the sound source by using convolution operation to generate stereo sound of the sound source.
And (5) space rendering. According to the initial position, direction and movement speed of a learner, under the condition of considering Doppler effect, combining the position, direction and movement change of a sound source, obtaining the movement tracks of the learner in a VR learning environment, and rendering the sound volumes with different intensities on the left and right ear sound channels according to the relative change of the learner and the sound source, wherein for example, the movement tracks of the sound source are from right to left, and the distance is more and more far, so that the intensity of the right ear sound channel is gradually attenuated in the movement process; the left ear channel gradually weakens in intensity until the sound disappears.
S50, utilize wear-type virtual reality equipment, combine head tracking technique, video picture and the synchronous renewal of sound when supporting the student head in the VR learning environment and remove, look the multichannel of sense of hearing and fuse the show, wherein, wear-type virtual reality equipment includes: HTC VIVE, Oculus.
In one embodiment, a head tracking technology is combined to support synchronous update of video pictures and sound when the head of a learner moves in a VR learning environment, so that multi-channel fusion display of visual sense and auditory sense is realized. Specifically, the method comprises the following steps:
the head and the ear are synchronous. And tracking the position and the posture of the head of the learner in real time in the VR learning environment according to the refreshing frequency of the VR picture, re-determining the distance and the direction of the sound source relative to the learner, and realizing the rendering pace of the image picture observed by the learner and the heard sound.
The visual and audio are fused. According to teaching requirements, display contents are arranged in a VR learning environment, when a learner rotates the head, the visual angle can be positioned on the corresponding contents, and different volumes are rendered at the left ear and the right ear according to the distance and the direction of the learner from a sound source at the contents.
And eliminating multi-sound source interference. Aiming at the phenomenon that multiple sound sources exist in a VR learning environment, a sound source attenuation function is adopted to simulate a sound reverberation range model, so that the interference factors of the multiple sound sources are reduced.
And (4) multi-channel interactive design. Aiming at the requirement of multi-sense collaborative interaction of a learner in a VR learning environment, the multi-sense interactive behaviors are screened, judged, decided and fused according to the sequence of interactive tasks, interactive behaviors and interactive experience and corresponding parameters of an interactive object.
In a specific embodiment, the case interaction function is that a user uses a device to interact with a 3D model within a virtual scene. The case virtual scene is a virtual scene in which the user can freely walk. The case interaction function is that the user interacts with a virtual character and the user interacts with a virtual object. The user can control the listening to the dialog with the avatar in case interaction functions, and can pick up and drop the virtual object.
In a specific embodiment, as shown in fig. 5, the present invention relates to a system architecture framework of a virtual reality-based case teaching system and an implementation method thereof. The method comprises the following software layers: a series of software applications based on different teaching cases provide teaching content and immersive experience. Including 3D models, avatars, virtual environments. An interaction layer: the system is responsible for connecting software functions and hardware functions and embodies the combination of the software functions and the hardware functions through interactive actions. The virtual reality helmet and the controller capture the position and the action of a user and react in a software scene in real time. Hardware layer: for supporting the running of virtual reality applications, comprising: computer mainframe, display, treadmill, VR helmet (display), VR controller (handle), sensor. The computer host is provided with a Bluetooth component; the display is connected with the computer host through an HDMI (high-definition multimedia interface); the treadmill is connected with the computer host through a USB interface; the VR helmet is connected with a computer host through an HDMI interface and a USB interface; the VR controller is connected with a computer host through Bluetooth; the sensor is connected with the computer host through Bluetooth; the VR sensor is responsible for sensing the VR helmet and the VR controller; the running machine can position the current position of the VR helmet in a virtual scene, when a person walks or runs on the running machine, the moving speed and direction information of the person can be transmitted to the computer host, and the person can be seen to move through the VR helmet and the display screen.
In a specific embodiment, as shown in fig. 6, a flowchart of an implementation method of the case teaching system based on virtual reality and the implementation method thereof is provided. Firstly, creating contents contained in a virtual reality case teaching system and completing system development; after the system is finished, carrying out system test; after the system test is passed, the VR application is released to the Internet; in course teaching, the virtual reality case teaching system is provided for students to use.
In a specific embodiment, as shown in fig. 7, a flowchart of a specific implementation method of the case teaching system based on virtual reality and the implementation method thereof of the present invention includes:
step 1, virtual reality content creation, including teaching case content creation, virtual reality scene creation and virtual reality function development. Firstly, a teacher creates the content of a teaching case according to a teaching target, then creates a virtual scene according to the content provided by the teaching case, and develops the system function after creating the scene.
Step 2, testing the virtual reality case teaching system, including function testing, namely testing whether the system function is complete and can be normally used; the method comprises the following steps of (1) performing performance testing, testing whether a system can normally run, testing whether the problem that user experience is influenced by blocking and the like exists during running; and (4) performing regression testing to repair the found system problems and bugs and testing to confirm whether the problems and bugs are repaired.
And 3, issuing the virtual reality case teaching system, including system packaging, packaging system components together, performing system packaging, generating a packaged file, and uploading the file to a network for issuing.
And 4, using the virtual reality case teaching system by the students, wherein the course tasks are arranged for the students in the teaching, and after the students pick up the course tasks, using the virtual reality case teaching system to complete the experience of the virtual reality cases according to the course requirements and complete the course tasks.
In a specific embodiment, as shown in fig. 8, a content creation diagram of a virtual reality-based case teaching system and an implementation method thereof is provided.
Step 1, creating virtual reality case contents, wherein a teacher selects cases meeting course setting and purposes, creates characters according to the cases and adapts course teaching for the purpose of adaptation; after the creation of the text content is completed, audio transcription of the case content is carried out, the text is recorded by voice and edited, and an audio format file is generated.
And 2, making a virtual scene, wherein the virtual scene comprises a virtual environment, virtual characters and virtual objects. The virtual environment comprises virtual landform, weather effect, illumination quantity and illumination angle, and can be adjusted according to the actual situation of the case, so that the scene of the case is restored, and the students can feel that the case actually comes to the place where the case occurs; the virtual persons comprise persons directly related to the cases, the persons related to the cases refer to persons needing to obtain case information from the persons, and the persons not related to the cases, such as passers-by in the virtual world; the virtual objects comprise buildings, roads and tools, and the buildings, the roads and the tools are built according to cases, so that students can enter the buildings and walk on the roads to experience the experience of being personally on the scene.
And 3, developing virtual reality functions, namely interactive functions and conversation functions, wherein the interactive functions comprise manual operation and character or object interaction and system automatic operation interaction. The student can carry out interactive function operations such as picking up and putting down on objects in the scene, and walking in with the character will automatically call the student with gestures and voice. The conversation function comprises displaying a text conversation box and playing audio, and when a student has a conversation with the virtual character, the student can see the conversation content displayed in the text box and can also hear the conversation content of the audio.
In a specific embodiment, as shown in fig. 9, a functional schematic diagram of a case teaching system based on virtual reality and an implementation method thereof is provided. The student wears VR equipment, operates this case teaching system, gets into this case teaching system, and the optional instruction of reading or not reading finishes the selection, and the experience begins normally.
The case teaching method based on the virtual reality technology is provided for teachers using the case teaching method. The method provides a new teaching mode for teachers from the creation of virtual reality case contents, the production of virtual scenes and the release and application of a virtual reality case teaching system.
Virtual reality case scenes are provided for students giving lessons by a case teaching method, and the students understand cases through the virtual scenes and enhance case analysis capacity and efficiency, so that the learning effect of the students is improved, and the teaching quality of teachers is improved. The scenes of the cases are restored through 3D modeling, and the scenes are provided for students to feel the places where the cases occur by combining VR interaction functions and audio conversations. The present invention uses a VR treadmill instead of a handle controller. The current VR device uses a handle controller to realize walking operation in a virtual scene. By using the VR treadmill, the virtual scene can be browsed in a walking mode without using a controller. This kind of experience makes student experience more real.
A second aspect.
Referring to fig. 10-13, the present invention provides an immersive virtual reality case-teaching display system, which includes:
the case simulation scene construction module 10 is used for constructing a case simulation scene by using a 3D modeling technology according to the acquired text information of the teaching case; wherein the case simulation scenario comprises: virtual terrain, virtual buildings, virtual environments, virtual characters, virtual objects, virtual weather, virtual lighting; the 3D modeling technique includes: 3DS MAX, Unity 3D.
The test module 20 is used for rendering and testing the case simulation scene; wherein the testing comprises: functional test, performance test and regression test.
And the issuing module 30 is configured to issue the case simulation scenes meeting the test conditions online.
In a specific embodiment, the method further comprises:
and the audio acquisition module 40 is used for acquiring the configuration audio of the case simulation scene.
And the audio fusion module 50 is used for binding the configuration audio with the virtual character through Unity3D, and setting a script according to the conversation content.
In a specific embodiment, the method further comprises:
and the space rendering module 60 is configured to utilize the head-mounted virtual reality device, combine a head speaker audio technology, support a doppler effect model, combine a binaural localization audio technology, and represent attenuation of objects and other background sound sources in the VR learning environment by using a linear volume-distance attenuation method, so as to implement a space rendering mode suitable for different object sounds and background sound effects in the VR scene.
In a specific embodiment, the method further comprises:
the synchronous update module 70 of audio frequency and video for utilize wear-type virtual reality equipment, combine the head tracking technique, video picture and the synchronous update of sound when supporting the removal of student's head in the VR learning environment, the multichannel that looks sense of hearing fuses the show, wherein, wear-type virtual reality equipment includes: HTC VIVE, Oculus.
In a third aspect.
An embodiment of the present invention provides an electronic device, which includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, and when the processor executes the computer program, the processor implements a case teaching presentation method of immersive virtual reality as described in any one of the above.
A fourth aspect.
An embodiment of the present invention provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, where when the computer program runs, the computer-readable storage medium is controlled to implement, on a device, any one of the above-mentioned immersive case teaching display methods of virtual reality.
Claims (10)
1. An immersive virtual reality case teaching display method is characterized by comprising the following steps:
constructing a case simulation scene by using a 3D modeling technology according to the acquired text information of the teaching case; wherein the case simulation scenario comprises: virtual terrain, virtual buildings, virtual environments, virtual characters, virtual objects, virtual weather, virtual lighting; the 3D modeling technique includes: 3DS MAX, Unity 3D;
rendering and testing the case simulation scene; wherein the testing comprises: functional test, performance test and regression test;
and releasing the case simulation scenes meeting the test conditions on line.
2. The immersive case teaching display method of claim 1, wherein after constructing the case simulation scene according to the text information of the obtained teaching case, the method further comprises:
collecting configuration audio of a case simulation scene;
and binding the configuration audio with the virtual character through Unity3D, and setting a script according to the conversation content.
3. The immersive virtual reality case teaching display method of claim 1, wherein after the case simulation scenes meeting the test conditions are released online, the method further comprises:
the method comprises the steps of utilizing head-mounted virtual reality equipment, combining a head loudspeaker audio technology, supporting Doppler effect model-based, combining a double-ear positioning audio technology, adopting a linear volume-distance attenuation method to represent attenuation of objects and other background sound sources in a VR learning environment, and performing space rendering suitable for different object sounds and background sound effects in a VR scene.
4. The immersive virtual reality case teaching display method of claim 1, wherein after the case simulation scenes meeting the test conditions are released online, the method further comprises:
utilize wear-type virtual reality equipment, combine the head tracking technique, video picture and the synchronous update of sound when supporting the removal of student's head in the VR learning environment, look the multichannel of sense of hearing and fuse the show, wherein, wear-type virtual reality equipment includes: HTC VIVE, Oculus.
5. An immersive virtual reality case teaching display system, comprising:
the case simulation scene construction module is used for constructing a case simulation scene by using a 3D modeling technology according to the acquired text information of the teaching case; wherein the case simulation scenario comprises: virtual terrain, virtual buildings, virtual environments, virtual characters, virtual objects, virtual weather, virtual lighting; the 3D modeling technique includes: 3DS MAX, Unity 3D;
the test module is used for rendering and testing the case simulation scene; wherein the testing comprises: functional test, performance test and regression test;
and the release module is used for releasing the case simulation scenes meeting the test conditions on line.
6. An immersive virtual reality case teaching presentation system as claimed in claim 5 further comprising:
the audio acquisition module is used for acquiring configuration audio of a case simulation scene;
and the audio fusion module is used for binding the configuration audio with the virtual character through Unity3D and setting a script according to the conversation content.
7. An immersive virtual reality case teaching presentation system as claimed in claim 5 further comprising:
the audio-visual combined space rendering module is used for utilizing the head-mounted virtual reality equipment, combining a head loudspeaker audio technology, supporting a Doppler effect model, combining a double-ear positioning audio technology, and representing attenuation of objects and other background sound sources in a VR learning environment by adopting a linear volume-distance attenuation method, so that a space rendering mode suitable for different object sounds and background sound effects in a VR scene is realized.
8. An immersive virtual reality case teaching presentation system as claimed in claim 5 further comprising:
the synchronous update module of audio frequency and video for utilize wear-type virtual reality equipment, combine the head tracking technique, video picture and the synchronous update of sound when supporting in the VR learning environment student head and removing, look the multichannel of sense of hearing and fuse the show, wherein, wear-type virtual reality equipment includes: HTC VIVE, Oculus.
9. An electronic device comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, when executing the computer program, implementing the immersive virtual reality case-teaching presentation method of any of claims 1-4.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a stored computer program, wherein the computer program, when running, controls a device on which the computer-readable storage medium is located to execute the immersive virtual reality case teaching presentation method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011132661.1A CN112783320A (en) | 2020-10-21 | 2020-10-21 | Immersive virtual reality case teaching display method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011132661.1A CN112783320A (en) | 2020-10-21 | 2020-10-21 | Immersive virtual reality case teaching display method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112783320A true CN112783320A (en) | 2021-05-11 |
Family
ID=75750751
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011132661.1A Pending CN112783320A (en) | 2020-10-21 | 2020-10-21 | Immersive virtual reality case teaching display method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112783320A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113509701A (en) * | 2021-07-15 | 2021-10-19 | 杭州轻程网络技术有限公司 | Method and system for controlling treadmill for learning |
| CN114327081A (en) * | 2022-02-25 | 2022-04-12 | 广东工业大学 | Virtual simulation environment design teaching form based on internet thinking |
| CN114359473A (en) * | 2021-11-30 | 2022-04-15 | 长沙宏达威爱信息科技有限公司 | Virtual display system of literary composition product VR |
| CN114697755A (en) * | 2022-03-31 | 2022-07-01 | 北京百度网讯科技有限公司 | Virtual scene information interaction method, device, equipment and storage medium |
| CN114779942A (en) * | 2022-05-23 | 2022-07-22 | 广州芸荟数字软件有限公司 | Virtual reality immersive interaction system, equipment and method |
| CN117436179A (en) * | 2023-12-12 | 2024-01-23 | 中交第四航务工程勘察设计院有限公司 | High-pile wharf teaching method and system based on lightweight engine technology |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109448456A (en) * | 2018-11-20 | 2019-03-08 | 北京农业智能装备技术研究中心 | A kind of biological control tutoring system and its application based on VR |
| CN111009158A (en) * | 2019-12-18 | 2020-04-14 | 华中师范大学 | Virtual learning environment multi-channel fusion display method for field practice teaching |
-
2020
- 2020-10-21 CN CN202011132661.1A patent/CN112783320A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109448456A (en) * | 2018-11-20 | 2019-03-08 | 北京农业智能装备技术研究中心 | A kind of biological control tutoring system and its application based on VR |
| CN111009158A (en) * | 2019-12-18 | 2020-04-14 | 华中师范大学 | Virtual learning environment multi-channel fusion display method for field practice teaching |
Non-Patent Citations (1)
| Title |
|---|
| 王阳萍等: "基于Arduino的虚拟现实交互系统实验案例设计", 《计算机教育》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113509701A (en) * | 2021-07-15 | 2021-10-19 | 杭州轻程网络技术有限公司 | Method and system for controlling treadmill for learning |
| CN114359473A (en) * | 2021-11-30 | 2022-04-15 | 长沙宏达威爱信息科技有限公司 | Virtual display system of literary composition product VR |
| CN114327081A (en) * | 2022-02-25 | 2022-04-12 | 广东工业大学 | Virtual simulation environment design teaching form based on internet thinking |
| CN114697755A (en) * | 2022-03-31 | 2022-07-01 | 北京百度网讯科技有限公司 | Virtual scene information interaction method, device, equipment and storage medium |
| CN114779942A (en) * | 2022-05-23 | 2022-07-22 | 广州芸荟数字软件有限公司 | Virtual reality immersive interaction system, equipment and method |
| CN117436179A (en) * | 2023-12-12 | 2024-01-23 | 中交第四航务工程勘察设计院有限公司 | High-pile wharf teaching method and system based on lightweight engine technology |
| CN117436179B (en) * | 2023-12-12 | 2024-04-26 | 中交第四航务工程勘察设计院有限公司 | High-pile wharf teaching method and system based on lightweight engine technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112783320A (en) | Immersive virtual reality case teaching display method and system | |
| CN110069139B (en) | Experience system for realizing tourism teaching practice by VR technology | |
| NL2026359B1 (en) | Method for multi-channel fusion and presentation of virtual learning environment oriented to field practice teaching | |
| CN103258338A (en) | Method and system for driving simulated virtual environments with real data | |
| Oleksiuk et al. | Exploring the potential of augmented reality for teaching school computer science | |
| Liu et al. | Applying tangible story avatars to enhance children's collaborative storytelling | |
| CN113129661A (en) | VR-based multi-user remote teaching system and teaching method thereof | |
| Hyndman | A simulation pedagogical approach to engaging generalist pre-service teachers in physical education online: The GoPro trial 1.0 | |
| Ritsos et al. | Using virtual reality for interpreter-mediated communication and training | |
| Mehm et al. | Introducing component-based templates into a game authoring tool | |
| Davidsen et al. | Researching interactional and volumetric scenographies–Immersive qualitative digital research | |
| Helle et al. | Miracle Handbook: Guidelines for Mixed Reality Applications for culture and learning experiences | |
| Mastrolembo Ventura et al. | Implementation of virtual reality in construction education: a content-analysis based literature review | |
| Begic et al. | Software prototype based on Augmented Reality for mastering vocabulary | |
| Cunningham et al. | Modeling interdisciplinary place-based learning in virtual worlds: lessons learned and suggestions for the future | |
| JP2021086146A (en) | Content control system, content control method, and content control program | |
| Cicconi et al. | Augmented Classrooms: A Generator of Augmented Environments for Learning | |
| US20120215507A1 (en) | Systems and methods for automated assessment within a virtual environment | |
| KR20210078886A (en) | Electronic device and method for 3d image playing based on ar | |
| JP7047168B1 (en) | Content provision system, content provision method, and content provision program | |
| Suryaman et al. | Managing Learning Experience in Introduction to Computer Network Device Using Virtual Reality: Study Case Network Laboratory | |
| AU2021103720A4 (en) | Virtual reality learning and amusement system based on artificial intelligence (ai) and iot | |
| KURBONOVA | CREATING A VIRTUAL GEOGRAPHIC LEARNING ENVIRONMENT AND ITS USER ASSESSMENT | |
| Azman et al. | The Development of Augmented Reality Mobile Application: BrainARnatomy. | |
| Trujano | Creating Novel Mixed Reality Experiences using existing sensors and peripherals |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210511 |