CN114025147A - Data transmission method and system for VR teaching, electronic equipment and storage medium - Google Patents
Data transmission method and system for VR teaching, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114025147A CN114025147A CN202111281469.3A CN202111281469A CN114025147A CN 114025147 A CN114025147 A CN 114025147A CN 202111281469 A CN202111281469 A CN 202111281469A CN 114025147 A CN114025147 A CN 114025147A
- Authority
- CN
- China
- Prior art keywords
- information
- teacher
- courseware
- control information
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 230000005540 biological transmission Effects 0.000 title claims abstract description 32
- 238000004891 communication Methods 0.000 claims abstract description 12
- 230000000694 effects Effects 0.000 abstract description 9
- 230000003993 interaction Effects 0.000 abstract description 7
- 230000008569 process Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000009471 action Effects 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000009877 rendering Methods 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 238000013500 data storage Methods 0.000 description 2
- 230000009365 direct transmission Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/194—Transmission of image signals
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
- G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/398—Synchronisation thereof; Control thereof
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Business, Economics & Management (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Computing Systems (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Electrically Operated Instructional Devices (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The application provides a data transmission method, a data transmission system, electronic equipment and a storage medium for VR teaching. The VR teaching system comprises a teacher end and a server end, wherein the teacher end is in communication connection with the student end through the server end, and the method comprises the following steps: receiving a first multi-type data set sent by a server, wherein the first multi-type data set comprises first 3D resource control information and courseware control information, and the first multi-type data set is sent to the server by a teacher; and controlling the first 3D resource according to the first 3D resource control information, and controlling the courseware video according to the courseware control information, wherein the first 3D resource and the courseware video are downloaded from the server side in advance and loaded locally. Control information is transmitted between the teacher end and the student end, so that the control effect of 3D resources and courseware videos of the student end is achieved, the interaction between the teacher end and the student end is well enhanced, and the teaching effect is improved.
Description
Technical Field
The application relates to the technical field of virtual reality, in particular to a data transmission method, a data transmission system, electronic equipment and a storage medium for VR teaching.
Background
Nowadays, with the development of VR (Virtual Reality) technology, various industries have come to new changes, and teachers and students can enjoy educational charm without going home by applying VR technology to the teaching field. More data types are also typically required to be transmitted during VR teaching.
In most VR teaching systems, three-dimensional teaching resources and courseware videos can only be played through a student terminal, the data transmission speed is low, interaction between students and teachers cannot be generated, and the experience of the students is not strong.
Disclosure of Invention
An object of the embodiment of the application is to provide a data transmission method, a data transmission system, electronic equipment and a storage medium for VR teaching, so as to solve the problem that interactivity between a teacher end and a student end is not high in VR teaching.
In a first aspect, an embodiment of the present application provides a data transmission method for VR teaching, which is applied to a student end of a VR teaching system, where the VR teaching system further includes a teacher end and a server end, and a communication connection is established between the teacher end and the student end through the server end, and the method includes: receiving a first multi-type data set sent by the server, wherein the first multi-type data set comprises first 3D resource control information and courseware control information, and the first multi-type data set is sent to the server by the teacher; and controlling a first 3D resource according to the first 3D resource control information, and controlling a courseware video according to the courseware control information, wherein the first 3D resource and the courseware video are downloaded from the server side in advance and are loaded locally.
In the embodiment of the application, the first multi-type data set is sent to the server by the teacher, and the student controls the locally loaded 3D resources and courseware videos according to the 3D resource control information and the courseware control information by receiving the first multi-type data set from the server, so that the 3D resources and the courseware videos can be played and controlled by the student, and interaction between the student and the teacher is enhanced.
Further, the number of the first 3D resources is multiple, the first 3D resource control information includes a sequence number of each first 3D resource and corresponding display information, and controlling the first 3D resources according to the first 3D resource control information includes:
determining a corresponding first 3D resource according to the sequence number of each first 3D resource;
controlling three-dimensional position, rotation angle, scaling, animation playing and whether to display of each of the first 3D resources through the display information.
In the embodiment of the application, the 3D resources loaded by the student terminal locally include a plurality of resources, because the first 3D resource control information includes the serial number of each first 3D resource and the corresponding display information, the currently loaded first 3D model can be determined through the serial number, and the three-dimensional position, the rotation angle, the scaling ratio, the animation playing and whether the display of the first 3D resource are controlled according to the display information, the first 3D resource can be controlled in real time according to the first 3D resource control information sent by the teacher terminal, so that the effect of the 3D resource can be better shown, and the perception of the student terminal is improved.
Furthermore, the number of the courseware videos is multiple, the courseware control information includes a courseware video sequence number and playing progress information, and the controlling of the courseware videos according to the courseware control information includes: playing a corresponding target courseware video according to the courseware video sequence number, wherein the target courseware video is one of the courseware videos; and playing the target courseware video according to the playing progress information.
In the embodiment of the application, the number of the courseware videos is multiple, the courseware control information comprises a courseware video sequence number and playing progress information, a currently played target courseware video can be determined through the courseware video sequence number, and then playing of the target courseware video can be controlled according to the playing progress information, so that the currently played courseware video can be controlled in real time to make corresponding adjustment, and the effect of real-time transmission is achieved.
Further, courseware control information still includes drawing board information, drawing board information includes pixel point coordinate and mark information, VR teaching system still includes that the teacher removes the end, the teacher remove the end with communication connection is established to the teacher end, receive the first polymorphic type data set that the server side sent includes: receiving the drawing board information sent by the server, wherein the drawing board information is sent to the teacher end by the teacher moving end and is sent to the server by the teacher end; correspondingly, the controlling the courseware video according to the courseware control information includes: and marking and displaying the courseware video according to the pixel point coordinates and the marking information so as to generate a teaching picture.
In the embodiment of the application, the VR teaching system further comprises a teaching moving end, the drawing board information sent by the server is received, the drawing board information can be input by a teacher moving end in a handwriting mode, the drawing board information is sent to the server through the teacher end and then sent by the server, the drawing board information comprises pixel point coordinates and mark information, the mark position in the current courseware video can be determined through the pixel point coordinates and the mark information, therefore, the mark information is displayed in the courseware video, and a teaching picture is generated. Through the input of drawing board information to can realize the demonstration of teacher's end drawing board at student's end, further enrich the teaching picture, promote the experience of teaching.
Further, the first multi-type data set further includes first operation information, where the first operation information is first question information sent by the teacher end to the server end or second question information sent by the teacher mobile end to the server end, and the method further includes: receiving the first operation information; and opening a corresponding interface according to the first operation information to display question information.
In the embodiment of the application, because first multi-type data set further includes first operation information, first operation information can be the question information that teacher's end sent to the server, also can be for the teacher to remove the second question information that the end sent to the server through teacher's end, through receiving this first operation information, student's end can open corresponding interface according to this first operation information and show question information, thereby realize student's end and receive teacher's question information, can let the student participate in VR teaching better.
Further, after the corresponding interface is opened according to the first operation information to display the question data, the method further includes: acquiring a second multi-type data set, wherein the second multi-type data set comprises second 3D resource control information and second operation information, and the second operation information is generated by the student end after answering according to the first operation data; sending the second 3D resource control information to the teacher end to realize control of the second 3D resource, wherein the second 3D resource is loaded locally by the teacher end in advance; and sending the second operation information to the teacher end through the server end so as to finish the answering text information display of the teacher end.
In the embodiment of the application, the student side can also obtain a second multi-type data set, the second multi-type data set comprises second 3D resource control information and second operation information, the second 3D resource control information and the second operation information are sent to the teacher side through the server side, control of the second 3D resource of the teacher side and display of answer text information of students are achieved, control right of the 3D resource of the teacher side can be switched to the student side, and interactivity in VR teaching is enhanced.
Further, the first multi-type data set is transmitted in a serialized manner between the student side and the teacher side.
In the embodiment of the application, the first multi-type data set can be transmitted between the student end and the teacher end in a serialization mode, and the first multi-type data set can be respectively converted into binary stream data through the serialization, so that the real-time transmission of the first multi-type data set at the student end and the teacher end is realized.
In a second aspect, an embodiment of the present application provides a VR teaching system, where the system includes a teacher end, a server end, and a student end; the server establishes communication connection with the teacher end and the plurality of student ends respectively; the teacher end is used for sending the first multi-type data set to the server end, and the first multi-type data set comprises first 3D resource control information and courseware control information; and the server is used for sending the first 3D resource control information and the courseware control information to the student.
In a third aspect, an embodiment of the present application provides an electronic device, including: the system comprises a processor, a memory and a bus, wherein the processor and the memory complete mutual interaction through the bus;
the memory stores program instructions executable by the processor, the processor being capable of performing the method of the first aspect when invoked by the program instructions.
In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, including:
the computer readable storage medium stores computer instructions which cause the computer to perform the method of the first aspect.
Additional features and advantages of the present application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the embodiments of the present application. The objectives and other advantages of the application may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a schematic flowchart of a data transmission method for VR teaching according to an embodiment of the present disclosure;
fig. 2 is a schematic structural diagram of a VR teaching system according to an embodiment of the present application;
fig. 3 is a schematic diagram of a data transmission flow in another VR teaching system according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
Fig. 1 is a schematic flow diagram of a data transmission method for VR teaching according to an embodiment of the present application, where the method is applicable to a student side in a VR teaching system, the VR teaching system further includes a teacher side and a server side, and a communication connection is established between the teacher side and the student side through the server side. It should be noted that, in the VR teaching system, the server may include a plurality of servers, each server is configured to manage data of a corresponding course, each server may connect the teacher end and a plurality of student ends, the teacher end and the student ends may be PC client ends, and operations may be implemented by installing client software provided by the VR teaching system, so as to complete VR teaching work of the course. As shown in fig. 1, the method includes:
step 101: and receiving a first multi-type data set sent by the server, wherein the first multi-type data set comprises first 3D resource control information and courseware control information, and the first multi-type data set is sent to the server by the teacher.
In a specific implementation process, the first multi-type data set is multi-type data, and can include first 3D resource control information and courseware control information, and can also include video information and audio information of a teacher collected by a teacher end, and can also be sent to a student end through a server end, so that video pictures and audio information of the teacher are played, and the receiving of the audio and video information of the student end is completed. The first 3D resource control information and the courseware control information are respectively collected by the teacher end, and the first 3D resource control information is control information of the teacher end 3D resource, such as three-dimensional coordinates and rotation effects of the 3D resource, and can be controlled. The courseware control information may be real-time courseware video playing control information of the teacher end, for example, a current courseware video sequence number played by the teacher end and a current playing progress.
Step 102: and controlling a first 3D resource according to the first 3D resource control information, and controlling a courseware video according to the courseware control information, wherein the first 3D resource and the courseware video are downloaded from the server side in advance and are loaded locally.
In a specific implementation process, before a classroom begins, 3D resources and courseware videos can be uploaded to a server by a teacher end in the classroom and are downloaded by a student end in advance and then loaded locally, display information of the first 3D resources can be controlled through first 3D resource control information, playing of the current courseware videos is controlled through courseware control information, VR teaching 3D scenes can be formed at the student end through superposition display of the 3D resources and the courseware videos, teaching pictures are switched continuously through real-time control information sent by the teacher end, data volume in a real-time transmission process can be effectively reduced through transmission of the first 3D resource control information and the courseware control information, a pause phenomenon which may occur in real-time transmission of the 3D resources and the courseware videos is avoided, and accordingly data transmission speed in VR teaching is improved, the interaction effect of the teacher end and the student end is enhanced.
On the basis of the foregoing embodiment, the number of the first 3D resources is multiple, the first 3D resource control information includes a sequence number of each first 3D resource and corresponding display information, and controlling the first 3D resource according to the first 3D resource control information includes:
determining a corresponding first 3D resource according to the sequence number of each first 3D resource;
controlling three-dimensional position, rotation angle, scaling, animation playing and whether to display of each of the first 3D resources through the display information.
In particular embodiments, the first 3D resource may be a plurality of resources, for example, in a geographic class, and may include a globe model, a sun model, a planet model, and so on. Each first 3D resource has a corresponding serial number and corresponding display information, where the display information may be position information, rotation information, zoom information, animation information, and display hidden information, and is used to display the first 3D resource.
The server can store 3D resource data in a table mode, the 3D resource data comprises 5 tables, and each element of each table stores classification information of one resource. The first table stores the position information of the resource, and an element in the table consists of three float type variables which respectively represent the coordinate positions of the resource in the x direction, the y direction and the z direction.
The position information can be stored through self-built Verctor3 types, and Verctor3 can store 3 float values, so that three rows of three-dimensional position coordinate information of each position information is reduced into one row of information for storage, the data size in data transmission is reduced, and rotation information and scaling information can also be stored through the Verctor3 types. The second table stores the rotation information of the resource, and one element in the table consists of three float type variables which respectively represent the rotation angles of the resource by taking x, y and z as axes. The third table stores the scaling information of the resource, and one element in the table consists of three float type variables which respectively represent the scaling of the resource in the x, y and z directions. The fourth table stores animation information of resources, each element in the table is composed of an int-type variable, 0 represents that no animation is played, 1 represents that the first animation is played, and the like. The fifth table records whether the resource is displayed or not, each element consists of a pool type variable, true represents the resource corresponding to the displayed element, and false represents the resource is hidden. The display information in each form of the server can be continuously updated through the first 3D resource control information transmitted by the teacher end in real time, and then the updated information is transmitted to the student end through the server end, so that the real-time control of the corresponding 3D resource is completed according to the first 3D resource control information, and the real-time synchronization effect of the 3D resource pictures of the teacher end and the student end is realized.
On the basis of the above embodiment, the number of the courseware videos is multiple, the courseware control information includes a courseware video sequence number and playing progress information, and the controlling the courseware videos according to the courseware control information includes:
playing a corresponding target courseware video according to the courseware video sequence number, wherein the target courseware video is one of the courseware videos;
and playing the target courseware video according to the playing progress information.
In a specific implementation process, the courseware video can be a plurality of VR courseware animations made by a teacher end, the VR courseware animations are downloaded to the local from a server end by the student end before a classroom begins, and the courseware video is controlled in real time according to courseware control information transmitted by the teacher end. The courseware control information can comprise courseware video sequence numbers and playing progress information, the server stores courseware control data through two variables, the first variable is an int type and used for representing the currently played courseware video sequence numbers, the second variable is playing progress information and is a float type and used for representing the currently played courseware video playing progress, and the size of the courseware control information is 0% -100%. The courseware control information stored in the server can update data of the server by receiving courseware control information transmitted from the teacher end in real time, then the courseware video played currently can be determined by receiving course control information transmitted by the server through courseware video sequence numbers, then the progress of the courseware video played currently is controlled through corresponding playing progress information, corresponding picture information is generated to be displayed, and the real-time synchronous playing effect of the courseware video between the teacher end and the student end is achieved.
On the basis of the above embodiment, the courseware control information further includes drawing board information, the drawing board information includes pixel coordinates and mark information, the VR teaching system further includes a teacher moving end, the teacher moving end and the teacher end establish communication connection, receive the first multi-type data set sent by the server, include:
receiving the drawing board information sent by the server, wherein the drawing board information is sent to the teacher end by the teacher moving end and is sent to the server by the teacher end;
correspondingly, the controlling the courseware video according to the courseware control information includes:
and marking and displaying the courseware video according to the pixel point coordinates and the marking information so as to generate a teaching picture.
In a specific implementation process, the VR teaching system further comprises a teacher moving end, wherein the teacher moving end can be a tablet computer, a mobile phone and other mobile terminals, and the specific form of the teacher moving end is not limited in the application. The teacher mobile terminal and the teacher terminal are in communication connection through the local area network, a faster data transmission method is provided, the teacher mobile terminal can be used for providing assistance for the teacher terminal, blackboard writing operation of a teacher is facilitated, and the teacher terminal can mark and display courseware videos in an overlapping mode according to received drawing board information. The drawing board information is information for marking pictures in a courseware video by a teacher moving end, drawing board data can be stored by using a table, and one element in the table consists of one pool type coordinate and two int type coordinates. The two int data represent the coordinates of a pixel point in the drawing board, and the pool type data represent whether the pixel point has graffiti or not. Through receiving the drawing board information from the server side, the drawing board information is synchronously displayed in the courseware video picture, so that the experience in VR teaching is improved, and the teaching quality in VR teaching is improved.
The drawing board can be realized by a Painter relying on a three-dimensional rendering software Unity Store. First, a line drawn by a user is displayed when the teacher operates to move the end. The point position information and the color information of the drawn line of the drawing board are stored in the table, so that the data of the whole drawing board are stored. And finally, the drawing board data is transmitted to a teacher end, so that the information synchronization of the drawing board of the teacher mobile end and the drawing board of the teacher end can be realized. The eraser function is added, only a new table is needed to store point information of the eraser, and the erased part of the drawing board can be updated in real time by adding the table when the drawing board data is transmitted.
On the basis of the foregoing embodiment, the first multi-type data set further includes first operation information, where the first operation information is first question information sent by the teacher terminal to the server terminal or second question information sent by the teacher mobile terminal to the server terminal, and the method further includes:
receiving the first operation information;
and opening a corresponding interface according to the first operation information to display question information.
In a specific implementation process, the first operation information may be first question information sent by a teacher end, or may be second question information that is synchronized to the teacher end by a teacher moving end and sent by the teacher end, where the second operation information may be represented by two tables, where the first table is used to represent question data of a teacher, and includes two data types: string type data is used for representing the content of the question, and int type data is used for representing the number of the student end and is used for determining the students who ask questions. The student end can open the corresponding interface according to the first operation information, so that the question content sent by the teacher end is displayed.
On the basis of the above embodiment, after the opening of the corresponding interface according to the first operation information to display the question data, the method further includes:
acquiring a second multi-type data set, wherein the second multi-type data set comprises second 3D resource control information and second operation information, and the second operation information is generated by the student end after answering according to the first operation data;
sending the second 3D resource control information to the teacher end to realize control of the second 3D resource, wherein the second 3D resource is loaded locally by the teacher end in advance;
and sending the second operation information to the teacher end through the server end so as to finish the answering text information display of the teacher end.
In a specific implementation process, after a corresponding interface is opened according to first operation information and question data sent by a teacher end is displayed, a student end can make some answers according to the question data, second operation information is operation information generated after the student end answers according to the first operation information, and the second operation information comprises answer text display content of the student end. The student end answering content can be displayed at the teacher end by transmitting the second operation information to the teacher end, so that the interactive effect in VR teaching is enhanced.
It should be noted that the second 3D resource is a 3D resource loaded at the teacher end, and corresponds to the first 3D resource locally loaded at the student end, and the student end can load the local 3D resource through the first 3D resource control information sent by the teacher end, so that the 3D resource rendering condition of the teacher end is synchronized to the student end. Similarly, the first operation information may further include resource control authority information of the 3D resource, and by receiving the resource control authority information sent by the teacher end, the student end may obtain the second 3D resource control information and transmit the second 3D resource control information to the teacher end, so as to achieve a control effect on the 3D resource of the teacher end, thereby synchronizing the 3D resource rendering condition of the student end to the teacher end, it should be understood that the synchronization of the 3D resource rendering picture between the teacher end and the student end is achieved by the transmission of the first 3D resource control information and the second 3D resource control information, thereby avoiding the direct transmission of the 3D resource, and increasing the speed of data transmission.
On the basis of the above embodiment, the first multi-type data set is transmitted in a serialized manner between the student side and the teacher side.
In a specific implementation process, in a data transmission process between a student side and a teacher side, a first multi-type data set can be transmitted in a serialization mode, the transmission in the serialization mode means that in network transmission, each data type in the first multi-type data set can be transmitted in a mode of converting into binary stream, and the binary stream data can be transmitted in a data structure of ProtoBuf to serialize structured data. The protocol is called Google protocol buffer, is an efficient and portable structured data storage mode, supports multiple languages, can be used for data communication protocols, data storage and the like, and is smaller (about 3-10 times of XML) and faster (about 20-100 times of XML) in data transmission rate compared with the XML.
For example: in the process that the student end sends the second 3D resource control information to the teacher end, the student end firstly serializes the second 3D resource control information into binary stream data and sends the binary stream data to the server end, the server end carries out deserialization on the binary stream data to obtain second 3D resource control information which is stored in a table, then the server end carries out serialization on the second 3D resource control information and converts the second 3D resource control information into binary stream data which is transmitted to the teacher end, and finally the teacher end carries out deserialization to obtain the second 3D resource control information to control the second 3D resource.
Fig. 2 is a schematic structural diagram of a VR teaching system provided in an embodiment of the present application, and as shown in fig. 2, the VR teaching system includes a teacher end 201, a server end 202, and a student end 203; the server 202 establishes communication connection with the teacher end 201 and the student end 202 respectively;
the teacher end 201 is configured to send the first multi-type data set to the server end 202, where the first multi-type data set includes first 3D resource control information and courseware control information;
the server 202 is configured to send the first 3D resource control information and the courseware control information to the student 203.
In the embodiment of the present application, it should be noted that the number of the student terminals may be multiple, and the present application does not limit the number of the student terminals. The teacher end 201 can send the first multi-type data set to the server end 202, and then the server end 202 forwards the first multi-type data set to the student end 203, where the first multi-type data set includes 3D resource control information and courseware control information, and the student end 203 controls the locally loaded first 3D resource according to the 3D resource control information and is further configured to control the locally loaded courseware video according to the courseware control information, so that the characteristic of small data volume of the control information is utilized to replace direct transmission of 3D resource and courseware resource picture data, and the data transmission rate in VR teaching is improved.
Fig. 3 is a schematic diagram of a data transmission process in another VR teaching system according to an embodiment of the present application, and as shown in fig. 3, the system includes a teacher end, a teacher moving end, a server end, and a student end, where the data transmission process of the system includes:
s301: the teacher mobile terminal sends the drawing board information and the first operation information to the teacher terminal;
s302: the teacher sends the first 3D resource control information, courseware control information, drawing board information, first operation information, first audio information and first video information to the server;
s303: the student terminal sends the second 3D resource control information, the second operation information, the second audio information and the second video information to the server terminal;
s304: the server receives the data from the teacher end and sends the data to the student end;
s305: the server receives the data from the self-learning terminal and sends the data to the teacher terminal.
Through the data transmission process, the student end and the teacher end can transmit the data sets acquired by the student end and the teacher end, and the server end can transmit the data sets in real time, so that real-time synchronization of VR teaching pictures of the teacher end and the server end is realized, interaction between the student end and the teacher end is enhanced, and teaching quality is improved.
Fig. 4 is a schematic structural diagram of an entity of an electronic device provided in an embodiment of the present application, and as shown in fig. 4, the electronic device includes: a processor (processor)401, a memory (memory)402, and a bus 403; wherein the content of the first and second substances,
the processor 401 and the memory 402 complete interaction with each other through the bus 403;
the processor 401 is configured to call program instructions in the memory 402 to perform the methods provided by the above-described method embodiments.
The processor 401 may be an integrated circuit chip having signal processing capabilities. The processor 401 may be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. Which may implement or perform the various methods, steps, and logic blocks disclosed in the embodiments of the present application. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The Memory 402 may include, but is not limited to, Random Access Memory (RAM), Read Only Memory (ROM), Programmable Read-Only Memory (PROM), Erasable Read-Only Memory (EPROM), Electrically Erasable Read-Only Memory (EEPROM), and the like.
The present embodiments disclose a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions which, when executed by a computer, enable the computer to perform the methods provided by the above-described method embodiments.
The present embodiment provides a computer-readable storage medium storing computer instructions that cause the computer to perform the methods provided by the above-described method embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed system and method may be implemented in other ways. The above-described system embodiments are merely illustrative, and for example, the division of the units is only one logical functional division, and there may be other divisions in actual implementation, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or mutual connection may be an indirect coupling or mutual connection of systems or units through some interactive interfaces, and may be in an electric, mechanical or other form.
In addition, units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
Furthermore, the functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. A VR teaching data transmission method is applied to a student end of a VR teaching system, the VR teaching system further comprises a teacher end and a server end, and communication connection is established between the teacher end and the student end through the server end, and the method comprises the following steps:
receiving a first multi-type data set sent by the server, wherein the first multi-type data set comprises first 3D resource control information and courseware control information, and the first multi-type data set is sent to the server by the teacher;
and controlling a first 3D resource according to the first 3D resource control information, and controlling a courseware video according to the courseware control information, wherein the first 3D resource and the courseware video are downloaded from the server side in advance and are loaded locally.
2. The method according to claim 1, wherein the number of the first 3D resources is plural, the first 3D resource control information includes a sequence number of each of the first 3D resources and corresponding display information, and the controlling the first 3D resources according to the first 3D resource control information includes:
determining a corresponding first 3D resource according to the sequence number of each first 3D resource;
controlling three-dimensional position, rotation angle, scaling, animation playing and whether to display of each of the first 3D resources through the display information.
3. The method of claim 1, wherein the number of the courseware videos is multiple, the courseware control information comprises a courseware video sequence number and playing progress information, and the controlling the courseware videos according to the courseware control information comprises:
playing a corresponding target courseware video according to the courseware video sequence number, wherein the target courseware video is one of the courseware videos;
and playing the target courseware video according to the playing progress information.
4. The method of claim 1, wherein the courseware control information further includes drawing board information, the drawing board information includes pixel coordinates and mark information, the VR teaching system further includes a teacher mobile terminal, the teacher mobile terminal and the teacher terminal establish a communication connection, and the receiving the first multi-type data set sent by the server terminal includes:
receiving the drawing board information sent by the server, wherein the drawing board information is sent to the teacher end by the teacher moving end and is sent to the server by the teacher end;
correspondingly, the controlling the courseware video according to the courseware control information includes:
and marking and displaying the courseware video according to the pixel point coordinates and the marking information so as to generate a teaching picture.
5. The method according to claim 4, wherein the first multi-type data set further includes first operation information, the first operation information is first question information sent by the teacher terminal to the server terminal or second question information sent by the teacher mobile terminal to the server terminal, and the method further includes:
receiving the first operation information;
and opening a corresponding interface according to the first operation information to display question information.
6. The method according to claim 5, wherein after the opening of the corresponding interface according to the first operation information to display question data, the method further comprises:
acquiring a second multi-type data set, wherein the second multi-type data set comprises second 3D resource control information and second operation information, and the second operation information is generated by the student end after answering according to the first operation information;
sending the second 3D resource control information to the teacher end to realize control of the second 3D resource, wherein the second 3D resource is loaded locally by the teacher end in advance;
and sending the second operation information to the teacher end through the server end so as to finish the answering text information display of the teacher end.
7. The method of any of claims 1-6, wherein said first multi-type data set is transmitted in a serialized manner between a student side and said teacher side.
8. A VR teaching system, the system comprising: the student side, teacher side and the server side of any one of claims 1-7;
the server establishes communication connection with the teacher end and the plurality of student ends respectively;
the teacher end is used for sending the first multi-type data set to the server end, and the first multi-type data set comprises first 3D resource control information and courseware control information;
and the server is used for sending the first 3D resource control information and the courseware control information to the student.
9. An electronic device, comprising: a processor, a memory, and a bus, wherein,
the processor and the memory are communicated with each other through the bus;
the memory stores program instructions executable by the processor, the processor invoking the program instructions to perform the method of any one of claims 1-7.
10. A computer-readable storage medium storing computer instructions which, when executed by a computer, cause the computer to perform the method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111281469.3A CN114025147A (en) | 2021-11-01 | 2021-11-01 | Data transmission method and system for VR teaching, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111281469.3A CN114025147A (en) | 2021-11-01 | 2021-11-01 | Data transmission method and system for VR teaching, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114025147A true CN114025147A (en) | 2022-02-08 |
Family
ID=80059442
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111281469.3A Pending CN114025147A (en) | 2021-11-01 | 2021-11-01 | Data transmission method and system for VR teaching, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114025147A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114664138A (en) * | 2022-05-20 | 2022-06-24 | 江苏立仞科技有限公司 | Teaching resource interaction method and system based on data stream pushing |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070134644A1 (en) * | 2005-12-11 | 2007-06-14 | Jones James G | 3D learning environment |
| CN106846940A (en) * | 2016-12-29 | 2017-06-13 | 珠海思课技术有限公司 | A kind of implementation method of online live streaming classroom education |
| CN107195210A (en) * | 2017-07-03 | 2017-09-22 | 北京大生在线科技有限公司 | Two dimension and the three-dimensional teleeducation system combined and control method |
| CN109191964A (en) * | 2018-10-12 | 2019-01-11 | 北京凌宇智控科技有限公司 | A kind of teaching interaction system based on virtual reality |
| CN110322377A (en) * | 2019-06-28 | 2019-10-11 | 德普信(天津)软件技术有限责任公司 | Teaching method and system based on virtual reality |
| CN111290583A (en) * | 2020-03-02 | 2020-06-16 | 北京萌科科技有限公司 | Three-dimensional blackboard writing generation method, electronic equipment and teaching system |
| WO2021073313A1 (en) * | 2019-10-16 | 2021-04-22 | 中兴通讯股份有限公司 | Method and device for conference control and conference participation, server, terminal, and storage medium |
-
2021
- 2021-11-01 CN CN202111281469.3A patent/CN114025147A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070134644A1 (en) * | 2005-12-11 | 2007-06-14 | Jones James G | 3D learning environment |
| CN106846940A (en) * | 2016-12-29 | 2017-06-13 | 珠海思课技术有限公司 | A kind of implementation method of online live streaming classroom education |
| CN107195210A (en) * | 2017-07-03 | 2017-09-22 | 北京大生在线科技有限公司 | Two dimension and the three-dimensional teleeducation system combined and control method |
| CN109191964A (en) * | 2018-10-12 | 2019-01-11 | 北京凌宇智控科技有限公司 | A kind of teaching interaction system based on virtual reality |
| CN110322377A (en) * | 2019-06-28 | 2019-10-11 | 德普信(天津)软件技术有限责任公司 | Teaching method and system based on virtual reality |
| WO2021073313A1 (en) * | 2019-10-16 | 2021-04-22 | 中兴通讯股份有限公司 | Method and device for conference control and conference participation, server, terminal, and storage medium |
| CN111290583A (en) * | 2020-03-02 | 2020-06-16 | 北京萌科科技有限公司 | Three-dimensional blackboard writing generation method, electronic equipment and teaching system |
Non-Patent Citations (2)
| Title |
|---|
| 薛亮: "《Java使用教程》", 西安电子科技大学出版社, pages: 41 - 42 * |
| 钟正 等: "基于VR技术的体验式学习环境设计策略与案例实现", 《中国电化教育》, pages 51 - 58 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114664138A (en) * | 2022-05-20 | 2022-06-24 | 江苏立仞科技有限公司 | Teaching resource interaction method and system based on data stream pushing |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107168674B (en) | Screen casting annotation method and system | |
| CN110570698B (en) | Online teaching control method and device, storage medium and terminal | |
| CN106875764B (en) | Virtual reality foreign language learning system based on network and control method | |
| CN102460487B (en) | The system and method for mixing course teaching | |
| CN110009967B (en) | One-to-many online collaborative programming teaching method and system | |
| US20170316714A1 (en) | Education system using virtual robots | |
| CN110427107A (en) | Virtually with real interactive teaching method and system, server, storage medium | |
| CN112286354A (en) | Education and teaching method and system based on virtual reality | |
| CN103561277A (en) | Transmission method and system for network teaching | |
| CN110619770A (en) | Draw live interactive teaching system of this courseware | |
| WO2023016107A1 (en) | Remote interaction method, apparatus and system, and electronic device and storage medium | |
| Pope et al. | The latest in immersive telepresence to support shared engineering education | |
| CN114025147A (en) | Data transmission method and system for VR teaching, electronic equipment and storage medium | |
| CN110794952A (en) | Virtual reality cooperative processing method, device and system | |
| CN113395534A (en) | Live playback video processing method, device, equipment and storage medium | |
| CN111352539A (en) | Method and device for terminal interaction | |
| CN114170859B (en) | Online teaching system and method based on virtual reality | |
| CN105224275A (en) | A kind of information processing method and device | |
| CN111766998B (en) | Data interaction method and device, electronic equipment and computer readable storage medium | |
| KR20190092796A (en) | Method for coding education based virtual environment graphic | |
| CN114168060A (en) | Electronic whiteboard rendering method, device, equipment and storage medium | |
| CN107909874A (en) | A kind of multimedia interaction tutoring system and its implementation | |
| CN210072615U (en) | Immersive training system and wearable equipment | |
| CN113382311A (en) | Online teaching interaction method and device, storage medium and terminal | |
| CN112820158A (en) | Virtual reality-based network teaching method and system, storage medium and platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |