CN113516031B - VR teaching system and multimedia classroom - Google Patents
VR teaching system and multimedia classroom Download PDFInfo
- Publication number
- CN113516031B CN113516031B CN202110473070.9A CN202110473070A CN113516031B CN 113516031 B CN113516031 B CN 113516031B CN 202110473070 A CN202110473070 A CN 202110473070A CN 113516031 B CN113516031 B CN 113516031B
- Authority
- CN
- China
- Prior art keywords
- student
- audio
- teacher
- playing
- students
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004891 communication Methods 0.000 claims abstract description 22
- 230000009471 action Effects 0.000 claims abstract description 19
- 230000003993 interaction Effects 0.000 claims abstract description 13
- 238000004364 calculation method Methods 0.000 claims description 4
- 238000013507 mapping Methods 0.000 claims description 4
- 238000000034 method Methods 0.000 claims description 4
- 238000012545 processing Methods 0.000 claims description 4
- 230000008859 change Effects 0.000 claims description 3
- 210000001747 pupil Anatomy 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 3
- 238000005516 engineering process Methods 0.000 description 11
- 230000009286 beneficial effect Effects 0.000 description 9
- QAOWNCQODCNURD-UHFFFAOYSA-N sulfuric acid Substances OS(O)(=O)=O QAOWNCQODCNURD-UHFFFAOYSA-N 0.000 description 8
- 230000002452 interceptive effect Effects 0.000 description 6
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 6
- 238000002474 experimental method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 2
- 238000010790 dilution Methods 0.000 description 2
- 239000012895 dilution Substances 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000007654 immersion Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241001310793 Podium Species 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/18—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using ultrasonic, sonic, or infrasonic waves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
- G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
Abstract
The invention provides a VR teaching system and a multimedia classroom, wherein the system comprises: the teacher terminal is used for receiving courses recorded or compiled by the teacher; the server is in communication connection with the teacher terminal and is used for receiving courses uploaded by the teacher terminal; the student terminal is in communication connection with the server side and is used for receiving and playing courses of the server side and receiving interaction actions of students when the courses are played; wherein, student terminal includes: at least one VR handle for receiving student interactions while the lesson is playing. The VR teaching system provided by the invention enables the user to actively participate in the VR scene so as to achieve a better learning effect.
Description
Technical Field
The invention relates to the technical field of teaching systems, in particular to a VR teaching system and a multimedia classroom.
Background
Currently, virtual Reality (VR) technology, also known as the smart technology, is a brand new practical technology developed in the 20 th century. The virtual reality technology comprises a computer, electronic information and simulation technology, and the basic implementation mode is that the computer simulates a virtual environment so as to bring the sense of environmental immersion. With the continuous development of social productivity and scientific technology, VR technology is increasingly required by various industries. VR technology has also made tremendous progress and has gradually become a new scientific and technological area.
The core content of educational informatization is educational informatization. Teaching is the central work in the education field, and teaching informatization is to make teaching means technological, educational propagation informatization and teaching mode modernization. The education informatization requires that modern information technology based on computer, multimedia, big data, artificial intelligence and network communication is comprehensively applied in the education process, and the education reform is promoted, so that the method is suitable for new requirements of the coming informatization society, and has great significance for the advanced education reform and the quality education. Therefore, the application of the VR technology and the informatization construction of education are significant, the existing VR technology can only play recorded broadcast, and the user cannot participate in the VR scene actively.
Disclosure of Invention
The invention aims to provide a VR teaching system, so that a user can actively participate in a VR scene to achieve a better learning effect.
The VR teaching system provided by the embodiment of the invention comprises:
the teacher terminal is used for receiving courses recorded or compiled by the teacher;
the server is in communication connection with the teacher terminal and is used for receiving courses uploaded by the teacher terminal;
the student terminal is in communication connection with the server side and is used for receiving and playing courses of the server side and receiving interaction actions of students when the courses are played;
wherein, student terminal includes:
at least one VR handle for receiving student interactions while the lesson is playing.
Preferably, the teacher terminal includes:
the audio acquisition equipment is used for acquiring audio information of teachers;
the image acquisition equipment is used for acquiring image information of a teacher;
the first control device is electrically connected with the audio acquisition device and the image acquisition device; the first control device is used for acquiring the audio information and the image information acquired by the audio acquisition device and the image acquisition device, and receiving the editing operation of a teacher on the audio information and the image information so as to generate courses;
the first control device includes:
the first communication module is in communication connection with the server side;
the display module is used for displaying the audio information and the image information;
the human input module is used for receiving editing operation of a teacher;
the processing module is electrically connected with the first communication module, the display module, the human input module, the audio acquisition equipment and the image acquisition equipment.
Preferably, the image acquisition apparatus includes:
and the at least four cameras shoot images of the teacher when recording courses from four directions of the front, the back, the left and the right of the teacher respectively.
Preferably, the audio collection device includes:
the microphones are arranged around the teacher in an array mode when the teacher records courses.
Preferably, the student terminal includes:
the wearable VR equipment is electrically connected with the VR handle and used for playing courses sent by the server side;
the first movement sensing module is arranged in the wearable VR equipment and is used for sensing movement of students;
the server side performs the following operations:
constructing a virtual course space based on the image information acquired by the image acquisition equipment and the audio information acquired by the audio acquisition equipment;
storing the virtual course space and the course correspondingly;
when receiving the state of playing courses by the student terminals, calling a corresponding virtual course space;
mapping the students to an initial point of a virtual course space, and playing images in a sight range of the students in the virtual course space;
sensing movement of the student through the first movement sensing module;
based on the movement of the students, determining images in the sight range of the students in real time and playing the images;
based on the movement and initial point of the student, determining the position of the student in the virtual course space, and playing the audio information acquired by the audio acquisition equipment corresponding to the position.
Preferably, based on the movement of the student, determining and playing the image in the sight line of the student in real time includes:
acquiring a central shooting vector of each camera constructing a virtual space, wherein the central shooting vector is a shooting direction which is a central point of a camera lens and perpendicular to the camera lens facing the camera;
obtaining a central vision vector of the student, wherein the central vision vector takes the pupil of the student as a starting point to outwards;
determining a position vector based on the student position and the teacher's position in the virtual lesson space;
when the included angle between the position vector and the central view vector is smaller than a preset first threshold, calculating the included angle between the central view vector and the central camera vector of each camera, wherein the calculation formula is as follows:
wherein θ i An included angle between the central view vector and the ith central shooting vector; x is x j A j-th dimension parameter value that is a center view vector; y is ij A j-th dimensional parameter value for the i-th center imaging vector; n is the data dimension;
comparing the angles, and selecting the image shot by the camera with the smallest angle as the image in the sight range of the student and playing the image;
based on the movement and initial point of the student, determining the position of the student in the virtual course space, playing the audio information collected by the audio collection device corresponding to the position, including:
the distance between the position of the student and the set position of each audio acquisition device is calculated by the following formula:
wherein L is k Distance between student position and k audio acquisition device setting position; a is that 1k 、A 2k 、A 3k Coordinate values of an X axis, a Y axis and a Z axis of the setting position of the kth audio acquisition device are respectively set; b (B) 1 、B 1 、B 1 Coordinate values of an X axis, a Y axis and a Z axis of the position of the student respectively;
comparing the distance between the position of the student and the set position of each audio acquisition device, and taking the audio information of the audio acquisition device with the shortest distance as the base audio;
determining a second distance between the position of the student and the position of the teacher in the virtual course space, and a third distance between the audio acquisition equipment with the shortest distance and the position of the teacher in the virtual course space;
inquiring a preset association coefficient table based on the first distance, the second distance and the third distance, and determining a relationship coefficient between the final playing audio and the basic audio;
based on the relationship coefficients and the base audio, a final playback audio is determined.
Preferably, the server side performs the following operations:
when receiving a first action of the students, representing the recorded notes, through the VR handle, acquiring a play point of a current played course, which is advanced by a preset time, as a recording starting point;
when receiving a second action of the student, which indicates that the note is finished, through the VR handle, acquiring a second position of the currently played course as a recording termination point;
the audio data between the recording starting point and the recording ending point are converted into text data, and the text data are output to students when the course is finished;
receiving the editing operation of students on the text data to form course notes; a step of
Wherein the first action comprises: pressing a key for pressing the VR handle; the second action includes: releasing the pressed key.
Preferably, the VR handle comprises:
the shell is cylindrical, and the periphery of the shell is provided with anti-skid grains;
a key set, which is arranged on one end face of the shell;
a pressure sensor array provided on the outer periphery of the housing;
the second movement sensing module is arranged in the shell and is used for sensing movement of the VR handle;
the processor is arranged in the shell and is electrically connected with the key, the second mobile sensing module and the pressure sensor array respectively;
the second communication module is electrically connected with the processor and the server side;
the processor detects the grip strength of the student through the pressure sensor array; when the grip strength is larger than a preset first pressure threshold value, the corresponding virtual image hand is gripped to grasp an object on the virtual image;
the processor senses the movement of the VR handle through the second sensing module so as to synchronously change the virtual images corresponding to the students to obtain the hand movement.
The invention also provides a multimedia classroom, which is applied to any VR teaching system, comprising:
and the plurality of VR handle connection interfaces are respectively arranged on each student seat and used for connecting VR handles.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings.
The technical scheme of the invention is further described in detail through the drawings and the embodiments.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate the invention and together with the embodiments of the invention, serve to explain the invention. In the drawings:
fig. 1 is a schematic diagram of a VR teaching system in an embodiment of the present invention;
fig. 2 is a schematic diagram of a teacher terminal according to an embodiment of the present invention;
fig. 3 is a schematic view of a VR handle in an embodiment of the invention.
Detailed Description
The preferred embodiments of the present invention will be described below with reference to the accompanying drawings, it being understood that the preferred embodiments described herein are for illustration and explanation of the present invention only, and are not intended to limit the present invention.
An embodiment of the present invention provides a VR teaching system, as shown in fig. 1, including:
a teacher terminal 1, configured to receive a course recorded or compiled by a teacher;
the server end 2 is in communication connection with the teacher terminal 1 and is used for receiving courses uploaded by the teacher terminal 1;
the student terminal 3 is in communication connection with the server side 2 and is used for receiving and playing courses of the server side 2 and receiving interaction actions of students when the courses are played;
wherein, student terminal 3 includes:
at least one VR handle 31 for receiving student interactions as the lesson is being played.
The working principle and the beneficial effects of the technical scheme are as follows:
the teacher terminal 1 is used by a teacher, and the teacher can use the teacher terminal 1 to compile or record courses; recording courses, namely recording the course of a teacher by adopting a video recording function; the course is complicated to build, and the interaction possibility of students needs to be considered when the course is played. For example: when the concentrated sulfuric acid dilution experiment is compiled, the correct step is to pour the concentrated sulfuric acid into water along the cup wall; there may be a variety of situations in the operation of students: 1. directly and instantaneously pouring water into concentrated sulfuric acid; 3. pouring concentrated sulfuric acid into water along the wall of the cup; when the video or phenomenon is compiled, various interactive operations of students need to be compiled respectively.
The student terminal 3 is used by students, and mainly the students log in the server side 2 for use; when the student uses the student terminal 3 to watch the course sent by the server side 2, interaction actions are realized through the VR handle 31, for example: video pause, playback, fast forward, etc.; in addition, the experiment operation can be performed during the playing of the experiment. For example, in the dilution experiment of the concentrated sulfuric acid, firstly, the concentrated sulfuric acid is directly poured into water instantly, and secondly, the water is poured into the concentrated sulfuric acid; 3. pouring concentrated sulfuric acid into water along the wall of the cup, and the like.
The VR teaching system provided by the invention enables a user to actively participate in a VR scene so as to achieve a better learning effect, and during dangerous experiments, accidents caused by errors of operation steps are avoided, and students can clearly and intuitively feel the results caused by the operation errors.
In one embodiment, as shown in fig. 2, the teacher terminal 1 includes:
an audio collection device 11 for collecting audio information of a teacher;
an image pickup device 12 for picking up image information of a teacher;
a first control device 13 electrically connected to the audio collection device 11 and the image collection device 12; the first control device 13 is configured to acquire audio information and image information acquired by the audio acquisition device 11 and the image acquisition device 12, and receive editing operations of teachers on the audio information and the image information to generate a lesson;
the first control device 13 includes:
the first communication module 132 is in communication connection with the server side 2;
a display module 133 for displaying audio information and image information;
a human input module 134 for receiving an edit operation of a teacher;
the processing module 131 is electrically connected with the first communication module 132, the display module 133, the human input module 134, the audio acquisition device 11 and the image acquisition device 12.
The working principle and the beneficial effects of the technical scheme are as follows:
the teacher terminal 1 respectively acquires video information and audio information of a course recorded by a teacher through the image acquisition device 12 and the audio acquisition device 11; and the course recording is realized. Editing the recorded courses; editing operations include editing, setting triggering interaction actions and the like; wherein the display module 133 is a display; the human input module 134 includes: a keyboard and a mouse; the first communication module 132 includes a network card; the processing module 131 is a computer host.
In one embodiment, image capture device 12 includes:
and the at least four cameras shoot images of the teacher when recording courses from four directions of the front, the back, the left and the right of the teacher respectively.
The working principle and the beneficial effects of the technical scheme are as follows:
panoramic recording is realized through omnibearing recording; when the student terminal 3 plays, the playing angle can be switched according to the interaction of the student, so that the student can feel as if the student is on the scene, and the learning experience of the student is improved.
In one embodiment, the audio acquisition device 11 comprises:
the microphones are arranged around the teacher in an array mode when the teacher records courses.
The working principle and the beneficial effects of the technical scheme are as follows:
through the microphone that the array set up, can realize all-round sound capture, realize synchronous switching sound's play when the student switches the broadcast angle. For example, four microphones can be adopted to correspond to the cameras one by one; and synchronously switching to play sound collected by the corresponding microphone when switching to the picture recorded by the corresponding camera.
In one embodiment, the student terminal 3 includes:
the wearable VR device is electrically connected with the VR handle 31 and used for playing courses sent by the server side 2;
the first movement sensing module is arranged in the wearable VR equipment and is used for sensing movement of students;
the server side 2 performs the following operations:
constructing a virtual lesson space based on the image information acquired by the image acquisition device 12 and the audio information acquired by the audio acquisition device 11;
storing the virtual course space and the course correspondingly;
when receiving the state of playing courses by the student terminals 3, calling a corresponding virtual course space;
mapping the students to an initial point of a virtual course space, and playing images in a sight range of the students in the virtual course space;
sensing movement of the student through the first movement sensing module;
based on the movement of the students, determining images in the sight range of the students in real time and playing the images;
based on the movement and initial point of the student, the position of the student in the virtual course space is determined, and the audio information collected by the audio collection device 11 corresponding to the position is played.
The working principle and the beneficial effects of the technical scheme are as follows:
based on the wearable VR equipment and the first mobile perception module, mapping between students and a virtual course space is achieved, images are displayed according to the visual angles of the students, corresponding visual angles and sounds can be switched according to movement of the students, and immersive learning experience is achieved.
In one embodiment, determining and playing images in the student's line of sight in real time based on the movement of the student includes:
acquiring a central shooting vector of each camera constructing a virtual space, wherein the central shooting vector is a shooting direction which is a central point of a camera lens and perpendicular to the camera lens facing the camera;
obtaining a central vision vector of the student, wherein the central vision vector takes the pupil of the student as a starting point to outwards;
determining a position vector based on the student position and the teacher's position in the virtual lesson space;
when the included angle between the position vector and the central view vector is smaller than a preset first threshold, calculating the included angle between the central view vector and the central camera vector of each camera, wherein the calculation formula is as follows:
wherein θ i An included angle between the central view vector and the ith central shooting vector; x is x j A j-th dimension parameter value that is a center view vector; y is ij A j-th dimensional parameter value for the i-th center imaging vector; n is the data dimension;
comparing the angles, and selecting the image shot by the camera with the smallest angle as the image in the sight range of the student and playing the image;
based on the movement and initial point of the student, determining the position of the student in the virtual course space, playing the audio information collected by the audio collection device 11 corresponding to the position, including:
the distance between the position of the student and the set position of each audio collection device 11 is calculated as follows:
wherein L is k Distance between the position of the student and the set position of the kth audio acquisition device 11; a is that 1k 、A 2k 、A 3k Coordinate values of an X axis, a Y axis and a Z axis of the setting position of the kth audio acquisition device 11, respectively; b (B) 1 、B 1 、B 1 Coordinate values of an X axis, a Y axis and a Z axis of the position of the student respectively;
comparing the distance between the position of the student and the setting position of each audio acquisition device 11, and taking the audio information of the audio acquisition device 11 with the shortest distance as the base audio;
determining a second distance between the position of the student and the position of the teacher in the virtual course space and a third distance between the audio acquisition equipment 11 with the shortest distance and the position of the teacher in the virtual course space;
inquiring a preset association coefficient table based on the first distance, the second distance and the third distance, and determining a relationship coefficient between the final playing audio and the basic audio;
based on the relationship coefficients and the base audio, a final playback audio is determined.
The working principle and the beneficial effects of the technical scheme are as follows:
the central view vector is used as a characterization parameter of the sight line, and whether the student views the lecture of the teacher can be determined through the included angle between the central view vector and the position vector; the first threshold may be set to 60 degrees only when the included angle thereof is smaller than the first threshold; when the included angle is larger than the first threshold, the background of the preset virtual course space can be played, and the direction of sight line adjustment is indicated by an arrow, so that students can conveniently and quickly adjust the sight line. When students speak class for watching teachers, the best display image is determined through the included angle between the central view vector and the central shooting vector so as to be displayed to the students. And the final playing audio is determined through the position of the student, so that accurate audio determination is realized. And then realized that audio and video changes according to student's removal, improved student's immersion, improved student's VR experience.
In one embodiment, the server side 2 performs the following operations:
when receiving a first action of the student representing a note taking through the VR handle 31, acquiring a play point of a currently played course, which advances forward by a preset time, as a record start point;
when receiving a second action of the student indicating the end of the note through the VR handle 31, acquiring a second position of the currently played course as a recording termination point;
the audio data between the recording starting point and the recording ending point are converted into text data, and the text data are output to students when the course is finished;
receiving the editing operation of students on the text data to form course notes; a step of
Wherein the first action comprises: pressing a key 313 holding the VR handle 31; the second action includes: the pressed key 313 is released.
The working principle and the beneficial effects of the technical scheme are as follows:
by pressing the key 313, the note recording function of the teaching system is started, the problem that a user cannot take notes when watching VR courses is solved, and the accuracy and efficiency of notes are improved by directly carrying out text conversion on audio data. Pushing the record starting point forward from the trigger point of the first action, and considering a response time of the student and a corresponding time of a command of the system, so as to ensure the integrity of note record; finally, the text data is edited according to the demands of students, and the editing includes deleting redundant data, so that the note is simplified. Further, the preset time is associated with the force path pressed by the key 313, that is, the larger the pressing force path is, the longer the preset time is, a corresponding table may be set in advance, and the recording start point is determined according to the preset time extracted from the pressing force path.
In one embodiment, as shown in fig. 3, VR handle 31 includes:
the shell is cylindrical, and the periphery of the shell is provided with anti-skid grains;
a key 313 provided on one end surface of the housing;
a pressure sensor array 314 disposed on the outer periphery of the housing;
a second movement sensing module 315 disposed within the housing for sensing movement of the VR handle 31;
the processor 311 is arranged in the shell and is electrically connected with the key 313, the second mobile sensing module 315 and the pressure sensor array 314 respectively;
the second communication module 312 is electrically connected with the processor 311 and the server side 2;
the processor 311 detects the grip of the student through the pressure sensor array 314; when the grip strength is larger than a preset first pressure threshold value, the corresponding virtual image hand is gripped to grasp an object on the virtual image;
the processor 311 senses the movement of the VR handle 31 through the second sensing module to synchronously change the hand movement of the avatar corresponding to the student.
The working principle and the beneficial effects of the technical scheme are as follows:
based on the second motion sensing module 315, the pressure sensor array 314, and the keys 313; input of interaction is realized; synchronizing the avatar with the student's operation of VR handle 31 facilitates the parameter manipulation during the student's immersive experience. Wherein the pressure sensor array 314 is a plurality of pressure sensors arranged in an array; the second movement awareness module 315 includes: three-axis gyroscopes and three-axis accelerometers.
The invention also provides a multimedia classroom, which is applied to any VR teaching system, comprising:
and a plurality of VR handle connection interfaces are respectively arranged on each student seat and used for connecting the VR handles 31.
The working principle and the beneficial effects of the technical scheme are as follows:
the VR handle connection interface is used for students to connect to enter the VR teaching system; and VR course learning is performed by multiple persons at the same time.
One specific application scenario: a large screen is arranged at the platform position of the teacher to display the course of the teacher; when the course enters the interactive operation end, the operation interfaces are respectively projected onto the small screens on the seats of the students, and the students perform interactive operation through the VR handle 31.
Yet another specific application scenario: the teacher carries out course explanation at the podium position, and when the course gets into interactive operation end, throw the operation interface respectively on the little screen on the student's seat, the student carries out the interactive operation through VR handle 31, and the interactive operation is accomplished the back and is summarized the teacher terminal 1 of operation process result to the teacher position.
Furthermore, holographic projection equipment is arranged at the teacher position to realize holographic projection of courses.
In addition, the multimedia teacher also provides access to wearable VR devices.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (4)
1. A VR teaching system, comprising:
the teacher terminal is used for receiving courses recorded or compiled by the teacher;
the server is in communication connection with the teacher terminal and is used for receiving the courses uploaded by the teacher terminal;
the student terminal is in communication connection with the server side and is used for receiving and playing the courses of the server side and receiving interaction actions of students when the courses are played;
wherein, student terminal includes:
at least one VR handle for receiving student interactions while the lesson is playing;
wherein, the teacher terminal includes:
the audio acquisition equipment is used for acquiring audio information of teachers;
the image acquisition equipment is used for acquiring image information of a teacher;
the first control device is electrically connected with the audio acquisition device and the image acquisition device; the first control device is used for acquiring the audio information and the image information acquired by the audio acquisition device and the image acquisition device, and receiving editing operation of a teacher on the audio information and the image information to generate the course;
the first control apparatus includes:
the first communication module is in communication connection with the server side;
the display module is used for displaying the audio information and the image information;
the human input module is used for receiving editing operation of a teacher;
the processing module is electrically connected with the first communication module, the display module, the human input module, the audio acquisition equipment and the image acquisition equipment;
wherein, the image acquisition device includes:
at least four cameras respectively shooting images of the teacher when recording courses from four directions of the front, the back, the left and the right of the teacher;
wherein, the audio acquisition device includes:
the microphones are arranged around the teacher in an array mode when the teacher records courses;
wherein, student terminal includes:
the wearable VR equipment is electrically connected with the VR handle and used for playing the courses sent by the server side;
the first movement sensing module is arranged in the wearable VR equipment and is used for sensing movement of students;
the server side performs the following operations:
constructing a virtual course space based on the image information acquired by the image acquisition equipment and the audio information acquired by the audio acquisition equipment;
storing the virtual course space and the course correspondingly;
when receiving the state of playing the course by the student terminal, calling a corresponding virtual course space;
mapping the students to the initial point of the virtual course space, and playing the images in the sight range of the students in the virtual course space;
sensing movement of the student through the first movement sensing module;
based on the movement of the students, determining the images in the sight range of the students in real time and playing the images;
determining the position of the student in the virtual course space based on the movement of the student and the initial point, and playing the audio information acquired by the audio acquisition equipment corresponding to the position;
the method for determining and playing the images in the sight range of the students in real time based on the movement of the students comprises the following steps:
acquiring a central shooting vector of each camera constructing a virtual space, wherein the central shooting vector is a shooting direction which is perpendicular to a shooting direction of the camera lens facing the camera by using a central point of the camera lens;
the central vision vector of the student is obtained, and the central vision vector is outwards from the pupil of the student;
determining a position vector based on the student position and a position of a teacher in the virtual lesson space;
when the included angle between the position vector and the central view vector is smaller than a preset first threshold, calculating the included angle between the central view vector and the central shooting vector of each camera, wherein the calculation formula is as follows:
wherein θ i An included angle between the central view vector and the ith central shooting vector; x is x j A j-th dimensional parameter value for the center view vector; y is ij A j-th dimensional parameter value for the i-th said center shot vector; n is the data dimension;
comparing the size of the included angle, and selecting the image shot by the camera with the smallest included angle as the image in the sight range of the student and playing the image;
based on the movement of the student and the initial point, determining the position of the student in the virtual course space, playing the audio information acquired by the audio acquisition device corresponding to the position, including:
the distance between the position of the student and the set position of each audio acquisition device is calculated according to the following calculation formula:
wherein L is k A distance between the position of the student and the set position of the kth audio acquisition device; a is that 1k 、A 2k 、A 3k X-axis, Y-axis and Z-axis coordinate values of the setting position of the kth audio acquisition device are respectively; b (B) 1 、B 1 、B 1 Coordinate values of an X axis, a Y axis and a Z axis of the position of the student respectively;
comparing the first distance between the position of the student and the set position of each audio acquisition device, and taking the audio information of the audio acquisition device with the shortest distance as the base audio;
determining a second distance between the position of the student and the position of a teacher in the virtual course space and a third distance between the audio acquisition equipment with the shortest distance and the position of the teacher in the virtual course space;
inquiring a preset association coefficient table based on the first distance, the second distance and the third distance, and determining a relationship coefficient between the final playing audio and the basic audio;
and determining final playing audio based on the relation coefficient and the basic audio.
2. The VR teaching system of claim 1, wherein the server side performs the following operations:
when receiving a first action of the students, representing the recorded notes, through the VR handle, acquiring a play point of forward advancing a first position of a currently played course for a preset time as a recording starting point;
when receiving a second action of the student, which indicates that the note is finished, through the VR handle, acquiring a second position of the currently played course as a recording termination point;
the audio data between the recording starting point and the recording ending point are converted into text data, and the text data are output to the students when the course is finished;
receiving the editing operation of the student on the text data to form course notes;
wherein the first action comprises: pressing a key of the VR handle; the second action includes: releasing the pressed key.
3. The VR teaching system of claim 1, wherein said VR handle comprises:
the shell is cylindrical, and the periphery of the shell is provided with anti-skid grains;
a key set, which is arranged on one end face of the shell;
a pressure sensor array disposed on the outer periphery of the housing;
the second movement sensing module is arranged in the shell and is used for sensing movement of the VR handle;
the processor is arranged in the shell and is electrically connected with the key, the second mobile sensing module and the pressure sensor array respectively;
the second communication module is electrically connected with the processor and the server side;
the processor detects the grip strength of the student through the pressure sensor array; when the grip strength is larger than a preset first pressure threshold value, the corresponding virtual image hand is gripped to grasp an object on the virtual image;
the processor senses the movement of the VR handle through the second movement sensing module so as to synchronously change the virtual image corresponding to the student to obtain the hand movement.
4. A multimedia classroom for use in the VR teaching system of any of claims 1-3, comprising:
and the plurality of VR handle connection interfaces are respectively arranged on each student seat and used for connecting the VR handles.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110473070.9A CN113516031B (en) | 2021-04-29 | 2021-04-29 | VR teaching system and multimedia classroom |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110473070.9A CN113516031B (en) | 2021-04-29 | 2021-04-29 | VR teaching system and multimedia classroom |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113516031A CN113516031A (en) | 2021-10-19 |
| CN113516031B true CN113516031B (en) | 2024-03-19 |
Family
ID=78063502
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110473070.9A Active CN113516031B (en) | 2021-04-29 | 2021-04-29 | VR teaching system and multimedia classroom |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113516031B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114743419B (en) * | 2022-03-04 | 2024-03-29 | 国育产教融合教育科技(海南)有限公司 | VR-based multi-person virtual experiment teaching system |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105844987A (en) * | 2016-05-30 | 2016-08-10 | 深圳科润视讯技术有限公司 | Multimedia teaching interaction operating method and device |
| CN108172040A (en) * | 2018-01-18 | 2018-06-15 | 安徽三弟电子科技有限责任公司 | A kind of tutoring system based on VR virtual classrooms |
| CN109064811A (en) * | 2018-09-03 | 2018-12-21 | 温州大学 | A kind of tutoring system based on VR virtual classroom |
| CN109949187A (en) * | 2019-03-01 | 2019-06-28 | 北华大学 | A kind of novel Internet of Things teleeducation system and control method |
| CN110246383A (en) * | 2019-07-18 | 2019-09-17 | 许昌学院 | A kind of multimedia education system and its application method |
| CN110364041A (en) * | 2019-06-24 | 2019-10-22 | 科谊达(北京)智能科技有限公司 | A kind of classroom outdoor scene reproduction tutoring system |
| CN111081099A (en) * | 2019-09-28 | 2020-04-28 | 马鞍山问鼎网络科技有限公司 | Remote education system based on virtual reality technology |
| KR20200050281A (en) * | 2018-11-01 | 2020-05-11 | 유엔젤주식회사 | Learning Support System And Method Using Augmented Reality And Virtual reality based on Artificial Intelligence |
| CN111402651A (en) * | 2020-05-22 | 2020-07-10 | 丽水学院 | Intelligent teaching system based on VR technique |
| JP6739611B1 (en) * | 2019-11-28 | 2020-08-12 | 株式会社ドワンゴ | Class system, viewing terminal, information processing method and program |
| CN111787343A (en) * | 2020-06-23 | 2020-10-16 | 深圳市思考乐文化教育科技发展有限公司 | Classroom live broadcasting system with virtual live broadcasting and implementation method thereof |
| CN211787619U (en) * | 2020-05-14 | 2020-10-27 | 刘班 | Remote education and teaching system |
| CN111949822A (en) * | 2020-08-20 | 2020-11-17 | 山东大学 | Intelligent education video service system based on cloud computing and mobile terminal and operation method thereof |
| CN112087656A (en) * | 2020-09-08 | 2020-12-15 | 远光软件股份有限公司 | Online note generation method and device and electronic equipment |
| AU2020103849A4 (en) * | 2020-12-02 | 2021-02-11 | G. L. Bhong | QCIU- Education Environment System: Quantum Computing Integrated Development Education Environment Using IoT-Based System |
-
2021
- 2021-04-29 CN CN202110473070.9A patent/CN113516031B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105844987A (en) * | 2016-05-30 | 2016-08-10 | 深圳科润视讯技术有限公司 | Multimedia teaching interaction operating method and device |
| CN108172040A (en) * | 2018-01-18 | 2018-06-15 | 安徽三弟电子科技有限责任公司 | A kind of tutoring system based on VR virtual classrooms |
| CN109064811A (en) * | 2018-09-03 | 2018-12-21 | 温州大学 | A kind of tutoring system based on VR virtual classroom |
| KR20200050281A (en) * | 2018-11-01 | 2020-05-11 | 유엔젤주식회사 | Learning Support System And Method Using Augmented Reality And Virtual reality based on Artificial Intelligence |
| CN109949187A (en) * | 2019-03-01 | 2019-06-28 | 北华大学 | A kind of novel Internet of Things teleeducation system and control method |
| CN110364041A (en) * | 2019-06-24 | 2019-10-22 | 科谊达(北京)智能科技有限公司 | A kind of classroom outdoor scene reproduction tutoring system |
| CN110246383A (en) * | 2019-07-18 | 2019-09-17 | 许昌学院 | A kind of multimedia education system and its application method |
| CN111081099A (en) * | 2019-09-28 | 2020-04-28 | 马鞍山问鼎网络科技有限公司 | Remote education system based on virtual reality technology |
| JP6739611B1 (en) * | 2019-11-28 | 2020-08-12 | 株式会社ドワンゴ | Class system, viewing terminal, information processing method and program |
| CN211787619U (en) * | 2020-05-14 | 2020-10-27 | 刘班 | Remote education and teaching system |
| CN111402651A (en) * | 2020-05-22 | 2020-07-10 | 丽水学院 | Intelligent teaching system based on VR technique |
| CN111787343A (en) * | 2020-06-23 | 2020-10-16 | 深圳市思考乐文化教育科技发展有限公司 | Classroom live broadcasting system with virtual live broadcasting and implementation method thereof |
| CN111949822A (en) * | 2020-08-20 | 2020-11-17 | 山东大学 | Intelligent education video service system based on cloud computing and mobile terminal and operation method thereof |
| CN112087656A (en) * | 2020-09-08 | 2020-12-15 | 远光软件股份有限公司 | Online note generation method and device and electronic equipment |
| AU2020103849A4 (en) * | 2020-12-02 | 2021-02-11 | G. L. Bhong | QCIU- Education Environment System: Quantum Computing Integrated Development Education Environment Using IoT-Based System |
Non-Patent Citations (1)
| Title |
|---|
| 为远程教育插上翅膀――浅谈基于智能录播系统的课件制作;黄娟;;科技信息(第03期);第486+487、470页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113516031A (en) | 2021-10-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107103801B (en) | Remote three-dimensional scene interactive teaching system and control method | |
| JP4310916B2 (en) | Video display device | |
| EP4184927A1 (en) | Sound effect adjusting method and apparatus, device, storage medium, and computer program product | |
| US11595615B2 (en) | Conference device, method of controlling conference device, and computer storage medium | |
| JP6739611B1 (en) | Class system, viewing terminal, information processing method and program | |
| CN109922352A (en) | A kind of data processing method, device, electronic equipment and readable storage medium storing program for executing | |
| US11442685B2 (en) | Remote interaction via bi-directional mixed-reality telepresence | |
| CN203588489U (en) | A situational teaching device | |
| CN113516031B (en) | VR teaching system and multimedia classroom | |
| CN112331001A (en) | Teaching system based on virtual reality technology | |
| CN108335542A (en) | A kind of VR tutoring systems | |
| CN108831216B (en) | True three-dimensional virtual simulation interaction method and system | |
| JP6727388B1 (en) | Class system, viewing terminal, information processing method and program | |
| WO2008066705A1 (en) | Image capture apparatus with indicator | |
| CN112675527A (en) | Family education game system and method based on VR technology | |
| CN112288876A (en) | Long-distance AR identification server and system | |
| JP7130290B2 (en) | information extractor | |
| CN110262662A (en) | A kind of intelligent human-machine interaction method | |
| CN113259544B (en) | Remote interactive holographic demonstration system and method | |
| JP7465737B2 (en) | Teaching system, viewing terminal, information processing method and program | |
| CN210072615U (en) | Immersive training system and wearable equipment | |
| JP2008032787A (en) | Language learning system and program for language learning system | |
| JP7361612B2 (en) | Information processing method, information processing device, and program | |
| JP6864041B2 (en) | Information storage method and information storage system | |
| JP3759216B2 (en) | Television camera communication device and multipoint connection device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Country or region after: China Address after: Room 502-503, Floor 5, Building 5, Hongtai Smart Valley, No. 19, Sicheng Road, Tianhe District, Guangzhou, Guangdong 510000 Applicant after: Guangdong Feidie Virtual Reality Technology Co.,Ltd. Address before: 518000 3311, 3rd floor, building 1, aerospace building, No.51, Gaoxin South nine road, Gaoxin community, Yuehai street, Nanshan District, Shenzhen City, Guangdong Province Applicant before: Shenzhen FEIDIE Virtual Reality Technology Co.,Ltd. Country or region before: China |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |