CN115883524A - Multi-terminal data synchronization method and system in multimedia teaching - Google Patents

Multi-terminal data synchronization method and system in multimedia teaching Download PDF

Info

Publication number
CN115883524A
CN115883524A CN202310043288.XA CN202310043288A CN115883524A CN 115883524 A CN115883524 A CN 115883524A CN 202310043288 A CN202310043288 A CN 202310043288A CN 115883524 A CN115883524 A CN 115883524A
Authority
CN
China
Prior art keywords
terminal
server
main control
control terminal
teacher
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310043288.XA
Other languages
Chinese (zh)
Inventor
赵悦汐
王维
李辉
李南
程红兵
赵亮
贾文娜
严晓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jinmao Education Technology Co ltd
Original Assignee
Beijing Jinmao Education Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jinmao Education Technology Co ltd filed Critical Beijing Jinmao Education Technology Co ltd
Priority to CN202310043288.XA priority Critical patent/CN115883524A/en
Publication of CN115883524A publication Critical patent/CN115883524A/en
Pending legal-status Critical Current

Links

Images

Abstract

The application provides a multi-terminal data synchronization method and system in multimedia teaching, which are used for solving the technical problems of page blockage and delay. Wherein, include: a first master control terminal sends a first master control instruction to a server of a B/S framework through a browser website port; the server sends execution service data to the first master control terminal according to the first master control instruction; the first main control terminal executes the service data; performing real-time network detection on the first master control terminal and the first controlled terminal; when the real-time network between the first main control terminal and the first controlled terminal is smooth, so that the first main control terminal and the first controlled terminal have the same heartbeat packet parameters, the server sends execution service data to the first controlled terminal according to the first main control instruction; and the first controlled terminal executes the service data. Therefore, online transmission of multi-terminal data is not needed, and only operation data of a teacher on the progress of the course files needs to be processed, so that the situations of unsmooth and delay of pages of a teacher end and a student end are reduced.

Description

Multi-terminal data synchronization method and system in multimedia teaching
Technical Field
The application relates to the technical field of remote control, in particular to a multi-terminal data synchronization method and system in multimedia teaching.
Background
With the continuous innovation of the education mode, the teaching mode of 'on-line teaching' is increasingly mature. "on-line teaching" may also be understood as "on-line classroom", i.e. the mode in which students and teachers communicate online over a network to develop classroom activities. Therefore, the teacher and the students can develop online teaching only by the aid of the equipment terminals which are connected to the network. When online teaching is carried out, a plurality of student ends are often provided, and all the student ends need to be successfully connected with the teacher end through a network.
In the prior art, the on-line classroom can realize split screen sharing based on an on-line conference system. The screen sharing of the online conference system can realize that everyone can share the screen of the online conference system. And the administrator controls the currently shared screen content and synchronizes the screen content to all the people. That is, when the administrator selects a screen of one user for sharing, all other users can see the screen of the user selected by the administrator.
In implementing the prior art, the inventors found that:
an online classroom system is built, and a complex audio and video processing technology is involved. The screen sharing is carried out on the basis of a classroom system, and not only is the video information flow used in the teaching course processed through a digital video compression technology, but also data generated when a user uses an application program needs to be synchronously processed. Therefore, animation in courseware, with many audio-visual streams, is generally bulky. The transmission process is limited by the network environment of the user, or the network bandwidth provided by the network provider is less than the bandwidth required for guaranteeing the quality of the audio and video stream, so that the animations in class at the teacher end and the students end are asynchronous, and the condition of delay or pause of the teacher end and the students end can occur.
Therefore, it is desirable to provide a method and a system for synchronizing data of multiple terminals in multimedia teaching, so as to solve the technical problems of page jamming and delay.
Disclosure of Invention
The embodiment of the application needs to provide a multi-terminal data synchronization method and system in multimedia teaching, so as to solve the technical problems of page jamming and delay.
Specifically, a multi-terminal data synchronization method in multimedia teaching comprises the following steps:
a first master control terminal sends a first master control instruction based on business logic to a server of a B/S framework through a browser website port;
the server sends execution service data to the first master control terminal according to the first master control instruction;
the first main control terminal executes service data based on the first main control instruction;
performing real-time network detection on the first master control terminal and the first controlled terminal;
when a real-time network between a first main control terminal and a first controlled terminal is smooth, so that the first main control terminal and the first controlled terminal have the same heartbeat packet parameters, a server sends execution service data to the first controlled terminal according to a first main control instruction;
and the first controlled terminal executes the service data based on the first master control instruction.
Further, the method further comprises:
the method comprises the steps that a first main control terminal and a first controlled terminal establish a real-time network based on a Web Socket protocol;
the first main control terminal transmits heartbeat packet data with the first controlled terminal through a real-time network based on a Web Socket protocol.
Further, the server sends the execution service data to the first controlled terminal according to the first master control instruction, and the method specifically includes:
the server records the operation event in the first master control instruction and the parameter describing the operation event;
and the server transmits the operation event and the parameters describing the operation event through a Web Socket protocol.
Further, the method is used for processing the animation in the multimedia teaching.
The embodiment of the application also provides a multi-terminal data synchronization method in multimedia teaching, which comprises the following steps:
the second controlled terminal sends a data request to the server through a Web Socket protocol;
the method comprises the steps that a server reads a log which records an operation event of a first main control terminal and parameters describing the operation event;
when the first main control terminal is configured to be in a synchronous mode, real-time network detection is carried out on the first main control terminal and the first controlled terminal;
when a real-time network between the first main control terminal and the first controlled terminal is smooth, so that the first main control terminal and the first controlled terminal have the same heartbeat packet parameters, the server transmits the operation event and the parameters describing the operation event to the second controlled terminal through a Web Socket protocol;
and the second controlled terminal executes the operation event.
The embodiment of the application also provides a multi-terminal data synchronization method in multimedia teaching, which comprises the following steps:
the second controlled terminal sends a data request to the server through a Web Socket protocol;
the method comprises the steps that a server reads a log which records an operation event of a first main control terminal and parameters describing the operation event;
when the first main control terminal is configured to be in an asynchronous mode, the server transmits the operation event defined by default and parameters describing the operation event to the second controlled terminal through a Web Socket protocol;
and the second controlled terminal executes the operation event.
The embodiment of the present application further provides a multi-terminal data synchronization system in multimedia teaching, which is specifically configured to:
the control instruction sending device is used for the first main control terminal to send a first main control instruction based on business logic to the server of the B/S framework through the website port of the browser;
the control instruction response device is used for sending execution service data to the first main control terminal by the server according to the first main control instruction;
the execution device is used for the first main control terminal to execute the service data based on the first main control instruction;
the network detection device is used for carrying out real-time network detection on the first main control terminal and the first controlled terminal;
the control instruction response device is also used for sending execution service data to the first controlled terminal by the server according to the first main control instruction when the real-time network between the first main control terminal and the first controlled terminal is smooth so that the first main control terminal and the first controlled terminal have the same heartbeat packet parameters;
the executing device is further configured to execute, by the first controlled terminal, the service data based on the first master control instruction.
Further, the system is further configured to:
the method comprises the steps that a first main control terminal and a first controlled terminal establish a real-time network based on a Web Socket protocol;
the first main control terminal transmits heartbeat packet data with the first controlled terminal through a real-time network based on a Web Socket protocol.
Further, the server sends execution service data to the first controlled terminal according to the first master control instruction, and is specifically configured to:
the server records an operation event in the first master control instruction and a parameter describing the operation event;
and the server transmits the operation event and the parameters describing the operation event through a Web Socket protocol.
Further, the system is used for processing the animation in the multimedia teaching.
The technical scheme provided by the embodiment of the application has at least the following beneficial effects:
the teacher end and the student end can carry out data communication through the server of the B/S architecture. When the system is updated, only the server needs to be updated, and the browser does not need to be updated, so that the difficulty in developing the service system is reduced. The first main control terminal and the first controlled terminal have the same heartbeat packet parameters through monitoring a network between the first main control terminal and the first controlled terminal in real time, and fixed connection is achieved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a flowchart of a multi-terminal data synchronization method in multimedia teaching according to an embodiment of the present disclosure;
fig. 2 is a flowchart of another method for synchronizing data of multiple terminals in multimedia teaching according to an embodiment of the present disclosure;
fig. 3 is a flowchart of a multi-terminal data synchronization method in multimedia teaching according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a multi-terminal data synchronization system in multimedia teaching according to an embodiment of the present application.
100. Multi-terminal data synchronization system
11. Control command transmitting device
12. Control command response device
13. Actuator device
14. A network detection device.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.
Referring to fig. 1, the present application provides a method for synchronizing data of multiple terminals in multimedia teaching, comprising the following steps:
s110: and the first master control terminal sends a first master control instruction based on business logic to a server of the B/S framework through a browser website port.
The first master control terminal can be understood as a mobile terminal which has established a network connection relationship with the server.
In the multi-terminal data synchronization method in multimedia teaching provided by the application, the first master control terminal can be understood as a mobile terminal which is directly controlled by a teacher and has established a network connection relation with the server. For example, a mobile phone, a tablet computer, a notebook computer, and a desktop computer are used by the teacher during online teaching.
The browser website port may be understood as an outlet of the first main control terminal for communicating with the outside. The first master control terminal comprising a mobile phone, a tablet computer, a notebook computer, a desktop computer and the like used by the teacher can access the server through the browser website port and send a first master control instruction based on business logic.
The B/S (Browser/Server) architecture can be understood as a network architecture mode. By adopting the network architecture mode, only one server needs to be installed, and the client can operate by selecting a browser. Compared with the traditional C/S (Client/Server) architecture, the B/S architecture has the advantages that a user does not need to install a Client and only needs one browser to access the service.
It can be understood that the B/S architecture has strong distributivity, and can carry out business processing such as searching, browsing and the like at any time and any place only by a network and a browser. And the B/S architecture service is simple to expand, the server function can be added by adding the webpage, and all users can be synchronously updated. The system comprises two roles of an administrator and a common user. When the system is updated, only the server needs to be updated, and the browser does not need to be updated. The server can be understood as a service system developed for developing "on-line classroom/on-line teaching".
Further, the server adopts a Spring Boot and Spring Data architecture.
Spring Boot is a completely new programming framework designed to simplify the initial set-up and development process of new Spring applications. The framework uses a specific way to configure, thereby eliminating the need for developers to define a templated configuration. SpringData can be understood to provide a familiar and Spring-compliant programming model for data access while still retaining the special features of the associated data store. Which facilitates data access techniques, relational and non-relational databases, and cloud-based data services.
The business logic can be understood as rules and procedures that one entity unit should have in order to provide services to another entity unit. In a specific multimedia teaching scene, the service logic may be understood as a set of reasonable rules and flows made between the first main control terminal and the server according to the existing information in the multi-terminal data synchronization process in the multimedia teaching.
The first master control instruction may be understood as corresponding operation data received by the first master control terminal when the first master control terminal operator performs corresponding operation on the first master control terminal. In a multimedia teaching scene, the first master control instruction based on the business logic sent by the first master control terminal can be understood as corresponding operation data sent to the server by the first master control terminal including a mobile phone, a tablet computer, a notebook computer, a desktop computer and the like used by a teacher.
Further, the first master control instruction is an instruction based on a Web Socket protocol.
The Web Socket is a new protocol of HTML 5. HTML5 is a language description way in which HTML5 constructs Web content, and is a language way in which internet content is constructed and presented. The content viewed by a user when browsing a web page by any means is originally in HTML format, and is converted into information recognizable in the browser by some technical process.
For example, in a multimedia teaching scene, when a teacher explains a PPT in a classroom through a mobile terminal, the mobile terminal sends a corresponding page turning and video playing instruction to a server based on the logic operated between the mobile terminal and the server. Playing the video instruction herein includes playing audio, video files, etc. contained in the courseware. It can be understood that, at this time, the server may receive the first main control instruction sent by the first main control terminal, and generate corresponding execution service data.
The multi-terminal data synchronization method in multimedia teaching provided by the embodiment of the application is mainly used for realizing interaction of World Wide Web (Web) application. That is, the multi-terminal data synchronization mainly refers to the synchronization between the mobile terminal for the teacher to log in and the mobile terminal for the student to log in. And when the mobile terminal on which the teacher logs in executes corresponding operation, the server can send the corresponding operation execution data to the mobile terminal on which the student logs in, so that the Web pages displayed by the terminals are kept consistent, and synchronization is realized.
S120: and the server sends the execution service data to the first main control terminal according to the first main control instruction.
S130: and the first master control terminal executes the service data based on the first master control instruction.
The first main control instruction may be understood as corresponding operation data received by the first main control terminal when the first main control terminal operator performs a corresponding operation at the first main control terminal. In a multimedia teaching scene, the first master control instruction based on the business logic sent by the first master control terminal can be understood as corresponding operation data sent to the server by the first master control terminal including a mobile phone, a tablet computer, a notebook computer, a desktop computer and the like used by the teacher.
It can be understood that, after receiving the first main control instruction sent by the first main control terminal, the server may generate an execution command corresponding to the first main control instruction according to the received first main control instruction, so that the first main control terminal executes a corresponding operation based on the first main control instruction.
The service data may be understood as an execution command generated by the server according to the first main control instruction and executed by the first main control terminal based on the first main control instruction.
In a specific teacher multimedia teaching application scenario provided by the application, the first master control terminal sends the first master control instruction based on the service logic, which can be understood as corresponding operation data sent to the server by the first master control terminal including a mobile phone, a tablet computer, a notebook computer, a desktop computer and the like used by the teacher. The teacher operates the tablet and the computer, and sends an instruction to the server when performing PPT teaching or correcting operation. And then the terminals such as the tablet personal computer and the like execute the instruction, so that the operations of turning pages, playing videos and the like can be realized, and the mobile terminal can accurately display the corresponding courseware change contents at the corresponding position of the display page of the mobile terminal according to the courseware turning pages and annotation instructions. It can be understood that when the teacher gives lessons on the mobile terminal, the first main control terminal displays the specific courseware contents of the operation performed by the teacher on the display screen of the mobile terminal in real time.
S140: and performing real-time network detection on the first master control terminal and the first controlled terminal.
The first master control terminal can be understood as a mobile terminal establishing a network connection relationship with the server.
The first controlled terminal can be understood as another mobile terminal which is different from the main control terminal and establishes a network connection relationship with the server.
The real-time network detection is used for detecting whether the first master control terminal and the first controlled terminal establish network connection with the server at the same time or not.
In a specific teacher multimedia teaching application scenario provided by the application, the first master control terminal can be understood as a mobile terminal which is directly controlled by a teacher and has established a network connection relationship with a server. For example, during online teaching, the teacher uses a mobile phone, a tablet computer, a notebook computer, a desktop computer, etc. for teaching. The first controlled terminal can be understood as a mobile terminal which is directly controlled by the student and has established network connection with the server. For example, during online teaching, students use mobile phones, tablet computers, notebook computers, desktop computers, etc. to attend to lessons.
The first master control terminal and the first controlled terminal carry out real-time network detection, and therefore the mobile terminals on which the teacher and the students log in are in a moving state, the mobile terminals on which the teacher and the students log in need to carry out continuous network detection, and the fixed connection between the teacher and the teaching server is ensured.
Network detection may be indicated by heartbeat detection. The heartbeat detection is a mode for monitoring whether processes, services and the like run online, and a client sends simple information to a server regularly to tell the server that the server is online. The heartbeat detection can judge whether the mobile terminals logged in by the teacher and the students are connected with the server or not. At the moment, the heartbeat packet is transmitted back and forth through a real-time network detection mechanism, so that the teacher end and the student end establish stable long connection in the Web socket. And when the server detects that the student end is disconnected or the teacher end is disconnected and the network condition of the student end or the teacher end cannot be detected again within 10s, the internal program of the server prompts the disconnection of the student end or the teacher end. The offline prompt is displayed on a page of the student end or the teacher end, so that the student can be reminded of entering a classroom in time, and the teaching efficiency is improved.
S150: and when the real-time network between the first main control terminal and the first controlled terminal is smooth, so that the first main control terminal and the first controlled terminal have the same heartbeat packet parameters, the server sends execution service data to the first controlled terminal according to the first main control instruction.
The first master control terminal can be understood as a mobile terminal establishing a network connection relationship with a server.
The first controlled terminal can be understood as another mobile terminal which is different from the main control terminal and establishes a network connection relationship with the server.
The real-time network smoothness between the first master control terminal and the first controlled terminal can be understood as that both the first master control terminal and the first controlled terminal establish fixed connection with the server, and the first master control terminal and the first controlled terminal can perform data communication through the server.
The heartbeat packet parameter can be understood as a parameter sent to the server in heartbeat detection. The heartbeat packet may be understood as a data packet sent by the first master control terminal and the first controlled terminal to the server at regular intervals. The content of the data packet is not specifically defined, and is generally a small data packet or a null packet including only the header.
In a specific application scenario of multimedia teaching for teachers, the first master control terminal can be understood as a mobile terminal which is directly controlled by the teachers and has a network connection relationship with the server. For example, a mobile phone, a tablet computer, a laptop computer, and a desktop computer are used by the teacher during online teaching. The first controlled terminal can be understood as a mobile terminal which is directly controlled by the student and has established network connection with the server. For example, during online teaching, students use mobile phones, tablet computers, notebook computers, and desktop computers. The first master control instruction can be understood as corresponding operation data sent to the server by the first master control terminal including a mobile phone, a tablet computer, a notebook computer, a desktop computer and the like used by the teacher. It can be understood that the teacher terminal sends the heartbeat packet to the server, and the student terminal sends the heartbeat packet to the server to establish connection while establishing connection. When the teacher end and the student end are fixedly connected with the server and can perform data communication through the server, the server sends execution service data to the student end according to corresponding operation data sent from the teacher end to the server.
Further, in a preferred embodiment provided by the present application, the sending, by the server, the execution service data to the first controlled terminal according to the first master control instruction specifically includes:
the server records the operation event in the first master control instruction and the parameter describing the operation event;
and the server transmits the operation event and the parameters describing the operation event through a Web Socket protocol.
The service data comprises an operation event in the first master control instruction and a parameter describing the operation event.
The first master control instruction may be understood as corresponding operation data received by the first master control terminal when the first master control terminal operator performs corresponding operation on the first master control terminal.
The operation event in the first master instruction may be understood as data specifically including an event in the corresponding operation data. The parameter describing the operation event in the first master instruction may be understood as data specifically including the event in the implementation of the corresponding operation data.
In a specific teacher multimedia teaching application scenario provided by the application, in the multimedia teaching scenario, the first master control instruction may be understood as corresponding operation data sent to a server by a first master control terminal including a mobile phone, a tablet computer, a notebook computer, a desktop computer, and the like used by a teacher. The operation event in the first main control instruction can be understood as a specific operation of a first main control terminal of a mobile phone, a tablet computer, a notebook computer, a desktop computer and the like used by a teacher, such as turning pages, playing audio and video and the like. The parameters describing the operation events in the first master control instruction can be understood as parameters required by the teacher when the first master control terminal is used for realizing specific operation events.
The Web Socket protocol can be understood as a new protocol of HTML5 (Hyper Text Markup Language 5). The HTML5 is a language description mode for constructing Web contents, and is used for describing Web pages. HTML5 is not a programming language but a markup language.
The Web Socket protocol allows a server side to send data to a terminal, is a full-duplex and bidirectional communication mode, and can keep long-time communication.
It can be understood that, in the synchronization control based on the online system, the volume of the audio/video stream is large, and in the transmission process, attention needs to be paid to the network environment and whether the network bandwidth provided by the network provider meets the use requirement. The transmission process is limited by the network environment of the user, or the network bandwidth provided by the network provider is less than the bandwidth required for guaranteeing the quality of the audio and video stream, and according to the wireless information transmission theory, the following results can be obtained: when the audio and video quality is ensured, because the maximum throughput of information on the network bandwidth is determined, if the network condition cannot be met, phenomena of transmission blockage, delay and the like occur; therefore, the problems of delay, pause and the like exist in the synchronous control of the teacher end and the student end. To reduce delay and reduce stutter, only audio-video quality can be compressed. However, the multi-terminal data synchronization method in the multimedia teaching provided by the application is not based on a video conference system. Therefore, online transmission of audio and video stream data does not need to be processed, and only operation data of a teacher on the progress of the course file needs to be processed. The operation data can be understood as a text type record file occupying a small memory, and can be transmitted in a network environment (such as civil hundred-million bandwidth or mobile phone 3g signals) without delay or jamming and the like.
S160: and the first controlled terminal executes the service data based on the first master control instruction.
The first controlled terminal can be understood as another mobile terminal which is different from the main control terminal and establishes a network connection relationship with the server.
The service data of the first master instruction can be understood as an operation event in the first master instruction and a parameter describing the operation event.
It can be understood that when online teaching is carried out, particularly, when teachers and students carry out online teaching in different places, specific operations of the teachers at teacher ends need to be synchronously transmitted to the students. Therefore, after receiving the first main control instruction sent by the first main control terminal, the server also needs to send the execution service data generated according to the first main control instruction to the first controlled terminal. At this time, the first controlled terminal executes the corresponding service data based on the first master control instruction.
In a specific application scenario of multimedia teaching for teachers, the first controlled terminal can be understood as a mobile terminal which is directly controlled by students and has established a network connection relationship with the server. For example, during online teaching, students use mobile phones, tablet computers, notebook computers, desktop computers, etc. to attend to lessons. The terminal used by the student to attend to the lesson executes the specific operation event sent out by the terminal used by the teacher so as to synchronize the operation event with the page of the teacher.
When the teacher carries out on-line teaching on the mobile terminal, the mobile terminal on which the teacher logs in can display courseware content of the teacher on a screen of the mobile terminal. Meanwhile, the server also sends corresponding instruction execution data generated according to the audio and video playing instruction to the mobile terminal for the student to log in, so that the mobile terminal for the student to log in can receive the operation event of the teacher on the courseware, and the terminal for the student to log in can accurately display the corresponding courseware operation content at the corresponding position of the display page of the terminal for the student to log in according to the audio and video playing instruction. Therefore, the concrete operation of the courseware by the mobile terminal logged in by the teacher is synchronized to the display screen of the student terminal, so that the students can synchronously obtain the concrete modification of the courseware by the teacher. Similarly, when the teacher turns pages of courseware, opens student answers and opens random roll call on the handheld mobile terminal, the display screen of the student terminal synchronously displays corresponding operation pages.
Further, in a preferred embodiment provided herein, the method further includes:
the method comprises the steps that a first main control terminal and a first controlled terminal establish a real-time network based on a Web Socket protocol;
the first main control terminal transmits heartbeat packet data with the first controlled terminal through a real-time network based on a Web Socket protocol.
The Web Socket protocol can be understood as a new protocol of HTML5 (Hyper Text Markup Language 5). The HTML5 is a language description mode for constructing Web contents, and is used for describing Web pages. HTML5 is not a programming language but a markup language.
The Web Socket protocol allows a server side to send data to a terminal, is a full-duplex and bidirectional communication mode, and can keep long-time communication.
The first master control terminal and the first controlled terminal establish a smooth real-time network, which can be understood that both the first master control terminal and the first controlled terminal establish a fixed connection with the server, and the first master control terminal and the first controlled terminal can perform data communication through the server.
The heartbeat packet may be understood as a data packet sent by the first main control terminal and the first controlled terminal to the server at a fixed time interval. The content of the data packet is not specifically defined, and is generally a small data packet or a null packet including only the header.
In a specific teacher multimedia teaching application scenario provided by the application, the first main control instruction is an instruction based on a Web Socket protocol, and it can be understood that transmission of the first main control instruction is based on the Web Socket protocol. That is, in the multi-terminal data synchronization method in multimedia teaching provided by the application, the teacher transmits the control command to the server through the Web Socket protocol.
It can be understood that the mobile phone, tablet computer, notebook computer, and desktop computer used by the teacher establish a real-time network based on the Web Socket protocol to the server mobile phone, tablet computer, notebook computer, desktop computer, and the like. It will be appreciated that at this point, the teacher and student ends establish a fixed data link for transmitting data. The teacher end transmits heartbeat packet data with the student end through a real-time network based on a WebSocket protocol. Here, the specific operation event issued in the terminal used by the teacher is synchronized with the page of the teacher.
It should be noted that the Web Socket Protocol is a Protocol for performing full duplex communication over a single Transmission Control Protocol TCP (Transmission Control Protocol, TCP for short), and can enable a server to actively push data to a client, so that data exchange between the client and the server is simpler. And the Web Socket protocol adopts an HTTP protocol to handshake, and in a Websocket application programming interface, the browser and the server only need to complete one-time handshake, and the browser and the server can directly establish persistent connection and perform bidirectional data transmission. Therefore, the Web Socket protocol communication is adopted, and after the client and the server complete one-time handshake, the server can actively push data to the client. The operation data of the teacher end in the application is transmitted through a WebSocket protocol. It can be understood that, during the on-line teaching, the teacher opens the on-line classroom and the student end establishes a connection with the server when joining the on-line classroom. Namely, the teacher end and the student end both complete handshake with the server. Therefore, when the teacher end executes corresponding operation, the server can actively execute the corresponding operation data to the student end without repeated handshake, so that the operation of the teacher end can be quickly synchronized to the student end, and the convenience of online teaching is improved.
Further, in a preferred embodiment provided by the present application, the method is used for processing animation in multimedia teaching.
The animation can be understood as audio and video files in multimedia.
It can be understood that, before the method processes and plays the animation in the multimedia teaching, the animation in the multimedia teaching is loaded and completed on the first main control terminal and the first controlled terminal. Here, the animation in the multimedia teaching is loaded in advance through the server.
In a specific application scenario of multimedia teaching for teachers, when a teacher performs online teaching, a mode of teaching can be selected on a mobile terminal on which the teacher logs in, for example, a mode of teaching such as Pad class, answerer class, dot matrix pen class, and the like. After the teacher has selected the class mode, taking the example after selecting Pad class, the teacher can select the class of the lecture. Then, the students can log in the mobile terminal to join the classroom. The student end can be controlled by the teacher end when just joining the classroom. At this time, the student cannot operate at the student end, and the page is synchronous with the teacher end. This process may be understood as "indifferent" control of the teacher's end over the student's end. The teacher end can select to play audio or video in the courseware to give lessons.
In the course of giving lessons, teachers do not need to process the online transmission of audio and video stream data, and only need to process the operation data of animation progress in multimedia teaching of different mobile terminals. The operation data is a text type record file with small volume, and the transmission in a network environment does not cause delay or pause of the mobile terminal.
In summary, the multi-terminal data synchronization method in multimedia teaching provided by the application enables the teacher end and the student end to perform data communication through the server with the B/S architecture, and establishes long connection based on the Web Socket protocol, thereby ensuring fixed connection between the two ends. The first main control terminal and the first controlled terminal have the same heartbeat package parameters by monitoring the network between the first main control terminal and the first controlled terminal in real time, and fixed connection is realized. When one of the terminals is disconnected, corresponding reminding can be carried out on the terminal page, and the efficiency of class teaching is effectively improved. The server records the operation event and the parameters describing the operation event in the first main control instruction, and then transmits the operation event and the parameters describing the operation event through the Web Socket protocol, which is equivalent to caching data in courseware in advance, so that the blocking and delay in the teaching process can be avoided.
Referring to fig. 2, the present application provides another method for synchronizing data of multiple terminals in multimedia teaching, which includes the following steps:
s210: and the second controlled terminal sends a data request to the server through a Web Socket protocol.
The second controlled terminal can be understood as another mobile terminal which is different from the first controlled terminal and establishes a network connection relationship with the server. The first and the second are used for distinguishing different mobile terminals and have certain priority.
The Web Socket protocol can be understood as a new protocol of HTML5 (Hyper Text Markup Language 5). The HTML5 is a language description mode for constructing Web contents, and is used for describing Web pages. HTML5 is not a programming language but a markup language.
The Web Socket protocol allows a server side to send data to a terminal, is a full-duplex and bidirectional communication mode, and can keep long-time communication.
The server may be understood as a service system developed for carrying out certain operational events.
In a specific teacher multimedia teaching application scenario provided by the application, the second controlled terminal can be understood as a mobile terminal for a student who enters a classroom to log in later. The second controlled terminal here is different from the first controlled terminal. The first controlled terminal establishes network connection with the first main control terminal before the second controlled terminal. The server can be understood as a service system developed for developing "on-line classroom/on-line teaching".
S220: the server reads a log which records an operation event of the first master control terminal and a parameter describing the operation event.
The first master control terminal can be understood as a mobile terminal which has established a network connection relationship with the server.
In the multi-terminal data synchronization method in multimedia teaching provided by the application, the first main control terminal can be understood as a mobile terminal which is directly controlled by a teacher and has established a network connection relation with a server. For example, a mobile phone, a tablet computer, a notebook computer, and a desktop computer are used by the teacher during online teaching. The terminal used by the student to attend to the lesson executes the specific operation event sent out by the terminal used by the teacher so as to synchronize the operation event with the page of the teacher.
The operation event in the first master instruction may be understood as data specifically including an event in the corresponding operation data. The parameter describing the operation event in the first master instruction may be understood as data of an implementation specific event in corresponding operation data.
The log can be understood as an event record generated by network equipment, a system, a service program and the like during operation. Each row of the log records the description of the date, time, user and action.
In a specific application scenario of multimedia teaching for a teacher, the operation event in the first main control instruction may be understood as a specific operation of a first main control terminal of a mobile phone, a tablet computer, a notebook computer, a desktop computer, and the like used by the teacher, for example, turning a page, playing audio and video, and the like. The parameters describing the operation events in the first master control instruction can be understood as parameters required by the teacher when the first master control terminal is used for realizing specific operation events.
When a teacher performs on-line teaching on a specific on-line teaching, the mobile terminal on which the teacher logs can display the courseware content of the teacher on a screen of the mobile terminal. Meanwhile, the server also sends corresponding instruction execution data generated according to the audio and video playing instruction to the mobile terminal for the student to log in, so that the mobile terminal for the student to log in can receive the operation event of the teacher on the courseware, and the terminal for the student to log in can accurately display the corresponding courseware operation content at the corresponding position of the display page of the terminal for the student to log in according to the audio and video playing instruction. Therefore, the concrete operation of the courseware by the mobile terminal logged in by the teacher is synchronized to the display screen of the student terminal, so that the students can synchronously obtain the concrete modification of the courseware by the teacher. Similarly, when the teacher turns pages of courseware, opens student answers and opens random roll call on the handheld mobile terminal, the display screen of the student terminal synchronously displays corresponding operation pages.
S230: and when the first master control terminal is configured to be in a synchronous mode, performing real-time network detection on the first master control terminal and the first controlled terminal.
The first master control terminal can be understood as a mobile terminal which has established a network connection relationship with the server.
The synchronization mode may be understood as communication synchronization, that is, the first master control terminal and the first controlled terminal establish a synchronous connection.
The real-time network detection is used for detecting whether the first main control terminal and the first controlled terminal establish network connection with the server at the same time or not.
The first master control terminal and the first controlled terminal perform real-time network detection, which can be understood that the mobile terminals logged in by the teacher and the students are in a moving state, so that the mobile terminals logged in by the teacher and the students need to perform continuous network detection, and the first master control terminal and the first controlled terminal are ensured to be fixedly connected with the teaching server at the same time.
Network detection may be indicated by heartbeat detection. The heartbeat detection is a mode for monitoring whether processes, services and the like run online or not, and a client sends simple information to a server regularly to tell the server that the server is online. The heartbeat detection can judge whether the mobile terminals logged in by the teacher and the students are connected with the server or not. At the moment, the heartbeat packet is transmitted back and forth through a real-time network detection mechanism, so that the teacher end and the student end establish stable long connection in the Web Socket. When the server detects that the student end is disconnected or the teacher end is disconnected and the network condition of the student end or the teacher end cannot be detected again within 10s, the internal program of the server prompts disconnection of the student end or the teacher end. The offline prompt is displayed on a page of the student end or the teacher end, so that the student can be reminded of entering a classroom in time, and the teaching efficiency is improved.
S240: and when the real-time network between the first main control terminal and the first controlled terminal is smooth, so that the first main control terminal and the first controlled terminal have the same heartbeat packet parameters, the server transmits the operation event and the parameters describing the operation event to the second controlled terminal through a Web Socket protocol.
S250: and the second controlled terminal executes the operation event.
The first master control terminal can be understood as a mobile terminal establishing a network connection relationship with a server.
The first controlled terminal can be understood as another mobile terminal which is different from the main control terminal and establishes a network connection relationship with the server. The second controlled terminal can be understood as another mobile terminal which is different from the first controlled terminal and establishes a network connection relationship with the server.
The real-time network smoothness between the first master control terminal and the first controlled terminal can be understood as that both the first master control terminal and the first controlled terminal establish fixed connection with the server, and the first master control terminal and the first controlled terminal can perform data communication through the server.
The heartbeat packet parameter may be understood as a parameter sent to the server in heartbeat detection. The heartbeat packet may be understood as a data packet sent by the first master control terminal and the first controlled terminal to the server at regular intervals. The content of the data packet is not specifically defined, and is generally a small data packet or a null packet including only the header.
The server may be understood as a service system developed for carrying out certain operational events. The Web Socket protocol can be understood as a new protocol of HTML5 (Hyper Text Markup Language 5). The HTML5 is a language description mode for constructing Web contents, and is used for describing Web pages. HTML5 is not a programming language but a markup language. The Web Socket protocol allows a server side to send data to a terminal, is a full-duplex and bidirectional communication mode, and can keep long-time communication.
The operation event in the first master instruction may be understood as data specifically including an event in the corresponding operation data. The parameter describing the operation event in the first master instruction may be understood as data of an implementation specific event in corresponding operation data.
In a specific teacher multimedia teaching application scenario provided by the application, the first master control terminal can be understood as a mobile terminal which is directly controlled by a teacher and has established a network connection relationship with a server. For example, a mobile phone, a tablet computer, a laptop computer, and a desktop computer are used by the teacher during online teaching. The first controlled terminal can be understood as a mobile terminal which is directly controlled by the student and has established network connection with the server. The second controlled terminal can be understood as a mobile terminal which is directly controlled by the student and has established a network connection relationship with the server.
It can be understood that the first controlled terminal establishes a connection with the first master control terminal before the second controlled terminal. Generally speaking, the first controlled terminal is a student who logs in the mobile terminal to enter the classroom initially when the classroom starts, and the second controlled terminal is a student who logs in the mobile terminal to enter the classroom after the classroom has been performed for a period of time. At this time, the pages of the mobile terminals logged in by the students who enter the classroom later are the same as the pages of the mobile terminals logged in by the students who enter the classroom earlier, and are kept synchronous with the pages of the teacher end.
The operation event can be understood as a specific operation of the first main control terminal of a mobile phone, a tablet computer, a notebook computer, a desktop computer and the like used by the teacher, such as page turning, audio and video playing and the like. The parameters describing the operation events can be understood as parameters required when the first master control terminal used by the teacher realizes specific operation events. And the server transmits the operation event and the parameters describing the operation event to the second controlled terminal through a Web Socket protocol.
In a specific teacher multimedia teaching application scenario provided by the present application, when the teacher is configured in a synchronization mode, that is, a classroom is still in progress, a page that is added to the classroom first is a page that is synchronized by the teacher. And the second controlled terminal, namely the mobile terminal logged in by the student who later joins in the classroom sends a message to the resource management of the bottom layer of the server through the communication mechanism of the Web Socket, so that the mobile terminal of the student who later joins in the classroom is synchronous with the page animation of the teacher. The student terminal and the server can be accessed again after disconnection.
In summary, the present application provides another multi-terminal data synchronization method in multimedia teaching, which establishes a long connection based on a Web Socket protocol, and ensures a fixed connection between two ends. When the first main control terminal is configured to be in a synchronous mode, real-time network detection is carried out on the first main control terminal and the first controlled terminal, so that the first main control terminal and the first controlled terminal have the same heartbeat packet parameters, and fixed connection is achieved. When one of the terminals is disconnected, the corresponding prompt is given on the terminal page, so that the efficiency of class teaching is effectively improved. The server records the operation events and the parameters describing the operation events in the first master control instruction, and then transmits the operation events and the parameters describing the operation events to the second controlled terminal through the Web Socket protocol, which is equivalent to caching data in a courseware in advance, so that students who join in a classroom later can be synchronized to a page of a current teacher terminal. At the moment, the student end is added into the classroom, the operation event of the teacher end and the parameter describing the operation event can be synchronously received, the blocking and the delay can not be caused in the teaching process, and the teaching efficiency of the online classroom is improved.
Referring to fig. 3, the present application provides another multi-terminal data synchronization method in multimedia teaching, including the following steps:
s310: and the second controlled terminal sends a data request to the server through a Web Socket protocol.
The second controlled terminal can be understood as another mobile terminal which is different from the first controlled terminal and establishes a network connection relationship with the server. Wherein the server may be understood as a service system developed for carrying out certain operational events.
The Web Socket protocol can be understood as a new protocol of HTML5 (Hyper Text Markup Language 5). The HTML5 is a language description mode for constructing Web contents, and is used for describing Web pages. HTML5 is not a programming language but a markup language. The Web Socket protocol allows a server side to send data to a terminal, is a full-duplex and bidirectional communication mode, and can keep long-time communication.
In a specific teacher multimedia teaching application scenario provided by the application, the second controlled terminal can be understood as a mobile terminal which is directly controlled by a student and has established a network connection relationship with the server. For example, during online teaching, students use mobile phones, tablet computers, notebook computers, desktop computers, etc. to attend to lessons. The second controlled terminal can be understood as a mobile terminal for a student who enters a classroom to log in later. The second controlled terminal here is different from the first controlled terminal. The first controlled terminal establishes network connection with the first main control terminal before the second controlled terminal. The server can be understood as a service system developed for developing "on-line classroom/on-line teaching". The second controlled terminal sends a data request to the server through a Web Socket protocol, and can be understood as that students who join in a classroom later send a request to the server to request to establish data connection with a teacher terminal.
S320: the server reads a log which records an operation event of the first master control terminal and a parameter describing the operation event.
The first master control terminal can be understood as a mobile terminal which has established a network connection relationship with the server.
In the multi-terminal data synchronization method in multimedia teaching provided by the application, the first main control terminal can be understood as a mobile terminal which is directly controlled by a teacher and has established a network connection relation with a server. For example, a mobile phone, a tablet computer, a notebook computer, and a desktop computer are used by the teacher during online teaching. The terminal used by the student to attend to the lesson executes the specific operation event sent out by the terminal used by the teacher so as to synchronize the operation event with the page of the teacher.
The operation event in the first master instruction may be understood as data specifically including an event in the corresponding operation data. The parameter describing the operation event in the first master instruction may be understood as data of an implementation specific event in corresponding operation data.
The log can be understood as an event record generated by network equipment, a system, a service program and the like during operation. Each row of the log records the description of the date, time, user and action.
In a specific application scenario of multimedia teaching for a teacher, the operation event in the first main control instruction may be understood as a specific operation of a first main control terminal of a mobile phone, a tablet computer, a notebook computer, a desktop computer, and the like used by the teacher, for example, turning a page, playing audio and video, and the like. The parameters describing the operation events in the first master control instruction can be understood as parameters required by the teacher when the first master control terminal is used for realizing specific operation events.
When the teacher carries out on-line teaching on the mobile terminal, the mobile terminal on which the teacher logs in can display courseware content of the teacher on a screen of the mobile terminal. Meanwhile, the server also sends corresponding instruction execution data generated according to the audio and video playing instruction to the mobile terminal for the student to log in, so that the mobile terminal for the student to log in can receive the operation event of the teacher on the courseware, and the terminal for the student to log in can accurately display the corresponding courseware operation content at the corresponding position of the display page of the terminal for the student to log in according to the audio and video playing instruction. Therefore, the concrete operation of the courseware by the mobile terminal logged in by the teacher is synchronized to the display screen of the student terminal, so that the students can synchronously obtain the concrete modification of the courseware by the teacher. Similarly, when the teacher turns pages of courseware, opens student answers and opens random roll call on the handheld mobile terminal, the display screen of the student terminal synchronously displays corresponding operation pages.
S330: and when the first main control terminal is configured to be in an asynchronous mode, the server transmits the operation event defined by default and parameters describing the operation event to the second controlled terminal through a Web Socket protocol.
S340: and the second controlled terminal executes the operation event.
The first master control terminal can be understood as a mobile terminal which has established a network connection relationship with a server. The second controlled terminal can be understood as another mobile terminal which is different from the first controlled terminal and establishes a network connection relationship with the server. The asynchronous mode can be understood as that the next task is executed immediately after the task is started, and the next task is not started until the task is finished.
The Web Socket protocol can be understood as a new protocol of HTML5 (Hyper Text Markup Language 5). The HTML5 is a language description mode for constructing Web contents, and is used for describing Web pages. HTML5 is not a programming language but a markup language. The Web Socket protocol allows a server side to send data to a terminal, is a full-duplex and bidirectional communication mode, and can keep long-time communication.
The default may be understood as a system default state, meaning the same as "default".
The operation event can be understood as data specifically containing the event in the corresponding operation data. The parameter describing the operation event in the first master instruction may be understood as data of an implementation specific event in corresponding operation data. The operation event of the default definition may be understood as data of a default event in the corresponding operation data. The default defined parameters describing the operational events may be understood as data implementing the default events in the corresponding operational data.
In a specific scenario of the multimedia teacher teaching application provided by the present application, when the teacher end is configured in an asynchronous mode, that is, when the classroom has ended, the page that was first added to the classroom will return to the first page of the classroom. And the second controlled terminal, namely the mobile terminal logged in by the student who later joins in the classroom sends a message to the resource management of the bottom layer of the server through the communication mechanism of the Web Socket, so that the mobile terminal of the student who later joins in the classroom can receive all operation events of the teacher for the class. The operation events include, but are not limited to, page turning, audio and video playing, correction jobs, and the like. It can be understood that the server records the operation event and the parameter describing the operation event at the teacher end each time, and uses WebSocket to push the operation event at the teacher end and the parameter describing the operation event to the student end. And the student end synchronously executes the animation after receiving the event parameters, and the animation replay is realized for all the operation events recorded by the teacher pushed by students who join the classroom later.
In summary, the present application provides another multi-terminal data synchronization method in multimedia teaching, which sends a data request to a server through a Web Socket protocol; the method comprises the steps that a server reads and records an operation event of a first main control terminal and a log describing parameters of the operation event; when the first main control terminal is configured to be in a synchronous mode, real-time network detection is carried out on the first main control terminal and the first controlled terminal; when a real-time network between the first main control terminal and the first controlled terminal is smooth, so that the first main control terminal and the first controlled terminal have the same heartbeat packet parameters, the server transmits the operation event and the parameters describing the operation event to the second controlled terminal through a Web Socket protocol; the second controlled terminal executes the operation event, so that the efficiency of teaching in the online classroom is improved.
In summary, the present application provides another multi-terminal data synchronization method in multimedia teaching, which establishes a long connection based on a Web Socket protocol, and ensures a fixed connection between two ends. When the first main control terminal is configured to be in an asynchronous mode, the server records the operation events and the parameters describing the operation events in the first main control instruction, and then the Web Socket protocol transmits the operation events and the parameters describing the operation events to the second controlled terminal, which is equivalent to caching data in the courseware in advance, so that students who later join in the classroom can receive all the operation events and the parameters describing the operation events during the classroom of the teacher end, the students who later join in the classroom can freely read the courseware in class, and the efficiency of teaching in the online classroom is improved.
The embodiment of the application also provides a multi-terminal control system, which is used for executing the steps S110-S160.
Referring to fig. 4, the present application provides a multi-terminal data synchronization system 100 in multimedia teaching, specifically configured to:
and the control instruction sending device 11 is used for the first main control terminal to send a first main control instruction based on the service logic to the server of the B/S framework through the website port of the browser.
The first master control terminal can be understood as a mobile terminal which has established a network connection relation with the server.
In the multi-terminal data synchronization method in multimedia teaching provided by the application, the first main control terminal can be understood as a mobile terminal which is directly controlled by a teacher and has established a network connection relation with a server. For example, a mobile phone, a tablet computer, a notebook computer, and a desktop computer are used by the teacher during online teaching.
The browser website port can be understood as an outlet of the first main control terminal for communicating with the outside. The first master control terminal comprising a mobile phone, a tablet computer, a notebook computer, a desktop computer and the like used by the teacher can access the server through the browser website port and send a first master control instruction based on business logic.
The B/S (Browser/Server) architecture can be understood as a network architecture mode. By adopting the network architecture mode, only one server needs to be installed, and the client can operate by selecting a browser. Compared with the traditional C/S (Client/Server) architecture, the B/S architecture has the advantages that a user does not need to install a Client and only needs one browser to access the service.
It can be understood that the B/S architecture has strong distributivity, and can carry out business processing such as searching, browsing processing and the like anytime and anywhere only by a network and a browser. And the B/S architecture service is simple to expand, the server function can be added by adding the webpage, and all users can be synchronously updated. The system comprises two roles of an administrator and a common user. When the system is updated, only the server needs to be updated, and the browser does not need to be updated. The server can be understood as a service system developed for developing "on-line classroom/on-line teaching".
Further, the server adopts a Spring Boot and Spring Data architecture.
Spring Boot is a completely new programming framework designed to simplify the initial set-up and development process of new Spring applications. The framework is configured in a specific way, so that developers no longer need to define a templated configuration. SpringData can be understood to provide a familiar and Spring-compliant programming model for data access while still retaining the special features of the associated data store. It facilitates data access techniques, relational and non-relational databases, map-reduce frameworks, and cloud-based data services.
The business logic can be understood as rules and procedures that one entity unit should have in order to provide services to another entity unit. In a specific multimedia teaching scene, the service logic may be understood as a set of reasonable rules and flows made between the first main control terminal and the server according to the existing information in the multi-terminal data synchronization process in the multimedia teaching.
The first master control instruction may be understood as corresponding operation data received by the first master control terminal when the first master control terminal operator performs corresponding operation on the first master control terminal. In a multimedia teaching scene, the first master control instruction based on the business logic sent by the first master control terminal can be understood as corresponding operation data sent to the server by the first master control terminal including a mobile phone, a tablet computer, a notebook computer, a desktop computer and the like used by the teacher.
Further, the first master control instruction is an instruction based on a Web Socket protocol.
The Web Socket is a new protocol of HTML 5. HTML5 is a language description way in which HTML5 constructs Web content, and is a language way in which internet content is constructed and presented. The content viewed by a user when browsing a web page by any means is originally in HTML format, and is converted into information recognizable in the browser by some technical process.
For example, in a multimedia teaching scene, when a teacher explains a classroom PPT at a mobile terminal, the mobile terminal sends a corresponding page turning and video playing instruction to a server based on the operation logic between the mobile terminal and the server. The video playing instruction includes playing audio and video files contained in the courseware. It can be understood that, at this time, the server may receive the first main control instruction sent by the first main control terminal, and generate corresponding execution service data.
The multi-terminal data synchronization method in the multimedia teaching provided by the embodiment of the application is mainly used for realizing the interaction of the global wide area network/world wide Web Web application. Namely, the multi-terminal data synchronization mainly refers to the synchronization between the mobile terminal logged in by the teacher and the mobile terminal logged in by the student. And when the mobile terminal logged in by the teacher executes corresponding operation, the server can send the corresponding operation execution data to the mobile terminal logged in by the students, so that the Web pages displayed by all the terminals are kept consistent, and synchronization is realized.
And a control instruction response device 12, configured to send, by the server, execution service data to the first master control terminal according to the first master control instruction.
And the executing device 13 is configured to execute the service data based on the first main control instruction by the first main control terminal.
The first master control instruction may be understood as corresponding operation data received by the first master control terminal when the first master control terminal operator performs corresponding operation on the first master control terminal. In a multimedia teaching scene, the first master control instruction based on the business logic sent by the first master control terminal can be understood as corresponding operation data sent to the server by the first master control terminal including a mobile phone, a tablet computer, a notebook computer, a desktop computer and the like used by a teacher.
It can be understood that, after receiving the first main control instruction sent by the first main control terminal, the server may generate an execution command corresponding to the first main control instruction according to the received first main control instruction, so that the first main control terminal executes a corresponding operation based on the first main control instruction.
The service data may be understood as an execution command generated by the server according to the first main control instruction and executed by the first main control terminal based on the first main control instruction.
In a specific application scenario of multimedia teaching for teachers provided by the present application, the first master control instruction sent by the first master control terminal based on the service logic may be understood as corresponding operation data sent to the server by the first master control terminal including a mobile phone, a tablet computer, a notebook computer, a desktop computer, and the like used by the teacher. The teacher operates the tablet and the computer, and sends an instruction to the server when performing PPT teaching or correcting operation. And then the terminals such as the tablet personal computer and the like execute the instruction, so that the operations of page turning, video playing and the like can be realized, and the mobile terminal can accurately display the corresponding courseware changing content at the corresponding position of the display page of the mobile terminal according to the courseware page turning and annotation instructions. It can be understood that, when a teacher gives lessons on the mobile terminal, the first master control terminal displays the specific courseware contents of the operations performed by the teacher on the display screen of the mobile terminal in real time.
The network detection device 14 is used for performing real-time network detection on the first master control terminal and the first controlled terminal.
The first master control terminal can be understood as a mobile terminal establishing a network connection relationship with a server.
The first controlled terminal can be understood as another mobile terminal which is different from the main control terminal and establishes a network connection relationship with the server.
The real-time network detection is used for detecting whether the first main control terminal and the first controlled terminal establish network connection with the server at the same time or not.
In a specific teacher multimedia teaching application scenario provided by the application, the first master control terminal can be understood as a mobile terminal which is directly controlled by a teacher and has established a network connection relationship with a server. For example, during online teaching, the teacher uses a mobile phone, a tablet computer, a notebook computer, a desktop computer, etc. for teaching. The first controlled terminal can be understood as a mobile terminal which is directly controlled by the student and has established network connection with the server. For example, during online teaching, students use mobile phones, tablet computers, notebook computers, desktop computers, etc. to attend to lessons.
The first master control terminal and the first controlled terminal carry out real-time network detection, and therefore the mobile terminals on which the teacher and the students log in are in a moving state, the mobile terminals on which the teacher and the students log in need to carry out continuous network detection, and the fixed connection between the teacher and the teaching server is ensured.
Network detection may be indicated by heartbeat detection. The heartbeat detection is a mode for monitoring whether processes, services and the like run online, and a client sends simple information to a server regularly to tell the server that the server is online. The heartbeat detection can judge whether the mobile terminals logged in by the teacher and the students are connected with the server or not. At the moment, the heartbeat packet is transmitted back and forth through a real-time network detection mechanism, so that the teacher end and the student end establish stable long connection in the Web Socket. And when the server detects that the student end is disconnected or the teacher end is disconnected and the network condition of the student end or the teacher end cannot be detected again within 10s, the internal program of the server prompts the disconnection of the student end or the teacher end. The off-line prompt is displayed on a page of the student end or the teacher end, so that the student can be reminded to enter a classroom in time, and the teaching efficiency is improved.
The control instruction responding device 12 is further configured to, when the real-time network between the first master control terminal and the first controlled terminal is smooth, so that the first master control terminal and the first controlled terminal have the same heartbeat packet parameter, send, by the server, execution service data to the first controlled terminal according to the first master control instruction.
The first master control terminal can be understood as a mobile terminal establishing a network connection relationship with a server.
The first controlled terminal can be understood as another mobile terminal which is different from the main control terminal and establishes a network connection relationship with the server.
The real-time network smoothness between the first master control terminal and the first controlled terminal can be understood as that both the first master control terminal and the first controlled terminal establish fixed connection with the server, and the first master control terminal and the first controlled terminal can perform data communication through the server.
The heartbeat packet parameter can be understood as a parameter sent to the server in heartbeat detection. The heartbeat packet may be understood as a data packet sent by the first main control terminal and the first controlled terminal to the server at a fixed time interval. The content of the data packet is not specifically defined, and is generally a small data packet or a null packet including only the header.
In a specific teacher multimedia teaching application scenario provided by the application, the first master control terminal can be understood as a mobile terminal which is directly controlled by a teacher and has established a network connection relationship with a server. For example, a mobile phone, a tablet computer, a notebook computer, and a desktop computer are used by the teacher during online teaching. The first controlled terminal can be understood as a mobile terminal which is directly controlled by the student and has established network connection with the server. For example, during online teaching, students use mobile phones, tablet computers, notebook computers, and desktop computers. The first master control instruction can be understood as corresponding operation data sent to the server by the first master control terminal of a mobile phone, a tablet computer, a notebook computer, a desktop computer and the like used by the teacher. It can be understood that the teacher terminal sends the heartbeat packet to the server, and the student terminal sends the heartbeat packet to the server to establish connection while establishing connection. When the teacher end and the student end are fixedly connected with the server and can perform data communication through the server, the server sends execution service data to the student end according to corresponding operation data sent from the teacher end to the server.
Further, in a preferred embodiment provided by the present application, the server sends execution service data to the first controlled terminal according to the first main control instruction, and specifically is configured to:
the server records the operation event in the first master control instruction and the parameter describing the operation event;
and the server transmits the operation event and the parameters describing the operation event through a Web Socket protocol.
The service data comprises an operation event in the first master control instruction and a parameter describing the operation event.
The first main control instruction may be understood as corresponding operation data received by the first main control terminal when the first main control terminal operator performs a corresponding operation at the first main control terminal.
The operation event in the first master instruction may be understood as data specifically including an event in the corresponding operation data. The parameter describing the operation event in the first master instruction may be understood as data specifically including the event in the implementation of the corresponding operation data.
In a specific teacher multimedia teaching application scenario provided by the application, in the multimedia teaching scenario, the first master control instruction may be understood as corresponding operation data sent to a server by a first master control terminal including a mobile phone, a tablet computer, a notebook computer, a desktop computer, and the like used by a teacher. The operation event in the first main control instruction can be understood as a specific operation of a first main control terminal of a mobile phone, a tablet computer, a notebook computer, a desktop computer and the like used by a teacher, such as turning pages, playing audio and video and the like. The parameters describing the operation events in the first master control instruction can be understood as parameters required by the first master control terminal used by the teacher to realize specific operation events.
The Web Socket protocol can be understood as a new protocol of HTML5 (Hyper Text Markup Language 5). The HTML5 is a language description way for constructing Web contents, and is used for describing Web pages. HTML5 is not a programming language but a markup language.
The Web Socket protocol allows a server side to send data to a terminal, is a full-duplex and bidirectional communication mode, and can keep long-time communication.
It can be understood that, in the synchronization control based on the online system, the volume of the audio/video stream is large, and in the transmission process, attention needs to be paid to the network environment and whether the network bandwidth provided by the network provider meets the use requirement. When the network environment of the user is not ideal, or the network bandwidth provided by the network provider is less than the bandwidth required for guaranteeing the quality of the audio and video stream, according to the wireless information transmission theory, it can be known that: when the audio and video quality is ensured, the maximum throughput of information on the network bandwidth is determined, and if the network condition is not met, the phenomena of transmission delay, delay and the like occur, so that the problems of delay, delay and the like exist in synchronous control of a teacher end and a student end. To reduce delay and reduce stutter, only audio-video quality can be compressed. However, the multi-terminal data synchronization method in multimedia teaching provided by the application is not based on a video conference system. Therefore, online transmission of audio and video stream data does not need to be processed, and only operation data of teachers on the progress of the course files need to be processed. The operation data can be understood as a text type record file occupying a small memory, and can be transmitted in a network environment (such as civil hundred mega bandwidth or mobile phone 3g signals) without delay or jamming and the like.
The executing device 13 is further configured to execute, by the first controlled terminal, the service data based on the first main control instruction.
The first controlled terminal can be understood as another mobile terminal which is different from the main control terminal and establishes a network connection relationship with the server.
The service data of the first master instruction can be understood as an operation event in the first master instruction and a parameter describing the operation event.
It can be understood that when online teaching is carried out, particularly, when teachers and students carry out online teaching in different places, specific operations of the teachers at teacher ends need to be synchronously transmitted to the students. Therefore, after receiving the first main control instruction sent by the first main control terminal, the server also needs to send the execution service data generated according to the first main control instruction to the first controlled terminal. At this time, the first controlled terminal executes the corresponding service data based on the first master control instruction.
In a specific teacher multimedia teaching application scenario provided by the application, the first controlled terminal can be understood as a mobile terminal which is directly controlled by a student and has established a network connection relationship with a server. For example, during online teaching, students use mobile phones, tablet computers, notebook computers, desktop computers, etc. to attend to lessons. The terminal used by the student to attend to the lesson executes the specific operation event sent out by the terminal used by the teacher so as to synchronize the operation event with the page of the teacher.
When the teacher carries out on-line teaching on the mobile terminal, the mobile terminal on which the teacher logs in can display courseware content of the teacher on a screen of the mobile terminal. Meanwhile, the server also sends corresponding instruction execution data generated according to the audio and video playing instruction to the mobile terminal for the student to log in, so that the mobile terminal for the student to log in can receive the operation event of the teacher on the courseware, and the terminal for the student to log in can accurately display the corresponding courseware operation content at the corresponding position of the display page of the terminal for the student to log in according to the audio and video playing instruction. Therefore, the concrete operation of the courseware by the mobile terminal logged in by the teacher is synchronized to the display screen of the student terminal, so that the students can synchronously obtain the concrete modification of the courseware by the teacher. Similarly, when the teacher turns pages of courseware, opens student answers and opens random roll call on the handheld mobile terminal, the display screen of the student terminal synchronously displays corresponding operation pages.
Further, in a preferred embodiment provided herein, the system 100 is further configured to:
the first master control terminal and the first controlled terminal establish a real-time network based on a Web Socket protocol;
the first main control terminal transmits heartbeat packet data with the first controlled terminal through a real-time network based on a Web Socket protocol.
The Web Socket protocol can be understood as a new protocol of HTML5 (Hyper Text Markup Language 5). The HTML5 is a language description mode for constructing Web contents, and is used for describing Web pages. HTML5 is not a programming language but a markup language.
The Web Socket protocol allows a server side to send data to a terminal, is a full-duplex and bidirectional communication mode, and can keep long-time communication.
The first master control terminal and the first controlled terminal establish smooth real-time network, that is, both establish fixed connection with the server, and the first master control terminal and the first controlled terminal can perform data communication through the server.
The heartbeat packet may be understood as a data packet sent by the first main control terminal and the first controlled terminal to the server at a fixed time interval. The content of the data packet is not specifically defined, and is generally a small data packet or a null packet including only the header.
In a specific teacher multimedia teaching application scenario provided by the application, the first main control instruction is an instruction based on a Web Socket protocol, and it can be understood that transmission of the first main control instruction is based on the Web Socket protocol. That is, in the multi-terminal data synchronization method in multimedia teaching provided by the application, the teacher transmits the control command to the server through the Web Socket protocol.
It can be understood that the mobile phone, tablet computer, notebook computer, and desktop computer used by the teacher establish a real-time network based on the Web Socket protocol to the server mobile phone, tablet computer, notebook computer, desktop computer, and the like. It will be appreciated that at this point, the teacher end and the student end establish a fixed data link for transmitting data. The teacher end transmits heartbeat packet data with the student end through a real-time network based on a WebSocket protocol. Here, the specific operation events issued in the terminal used by the teacher are synchronized with the pages at the teacher's end.
It should be noted that the Web Socket Protocol is a Protocol for performing full duplex communication over a single Transmission Control Protocol TCP (Transmission Control Protocol, TCP for short), and can enable a server to actively push data to a client, so that data exchange between the client and the server is simpler. And the Web Socket protocol adopts HTTP protocol to handshake, and in the Websocket application programming interface, the browser and the server only need to complete one handshake, and can directly establish persistent connection between the browser and the server and perform bidirectional data transmission. Therefore, the Web Socket protocol communication is adopted, and after the client and the server complete one-time handshake, the server can actively push data to the client. The operation data of the teacher end is transmitted through a WebSocket protocol. It can be understood that, during the on-line teaching, the teacher opens the on-line classroom, and the student end establishes a connection with the server when joining the on-line classroom. Namely, the teacher end and the student end both complete handshake with the server. Therefore, when the teacher end executes corresponding operation, the server can actively execute the corresponding operation data to the student end without repeated handshake, so that the operation of the teacher end can be quickly synchronized to the student end, and the convenience of online teaching is improved.
Further, in a preferred embodiment provided herein, the system 100 is used for processing animation in multimedia teaching.
The animation can be understood as audio and video files in multimedia.
It can be understood that, before the method processes and plays the animation in the multimedia teaching, the animation in the multimedia teaching is loaded on the first main control terminal and the first controlled terminal. Here, the animation in multimedia teaching is loaded in advance through the server.
In a specific application scenario of multimedia teaching for teachers, when the teachers perform online teaching, the modes of teaching, such as Pad class, answerer class, dot matrix pen class and the like, can be selected on the mobile terminals on which the teachers log in first. After the teacher has selected the class mode, taking the example after selecting Pad class, the teacher can select the class of the lecture. Then, the students can log in the mobile terminal to join the classroom. The student end can be controlled by the teacher end when just joining the classroom. At this time, the student cannot operate at the student end, and the page is synchronous with the teacher end. This process may be understood as "indifferent" control of the teacher's end over the student's end. The teacher end can select to play audio or video in the courseware to give lessons.
In the course of teaching, the teacher only needs to process the operation data of animation progress in multimedia teaching from different mobile terminals without processing the online transmission of audio and video stream data. The operation data is a text type record file with small volume, and the transmission in a network environment does not cause delay or jamming of the mobile terminal.
In summary, in the multi-terminal data synchronization system 100 in multimedia teaching provided by the present application, the control instruction sending device 11 is configured to enable a teacher end and a student end to perform data communication through a server in a B/S architecture, and establish a long connection based on a Web Socket protocol, so as to ensure a fixed connection between the two ends. The network detection device 14 monitors the network between the first master control terminal and the first controlled terminal in real time, so that the first master control terminal and the first controlled terminal have the same heartbeat packet parameter, thereby implementing fixed connection. When one of the terminals is disconnected, the corresponding prompt is given on the terminal page, so that the efficiency of class teaching is effectively improved. The server records the operation event and the parameters describing the operation event in the first main control instruction, and then transmits the operation event and the parameters describing the operation event through the WebSocket protocol, which is equivalent to caching data in courseware in advance, so that the blocking and delay in the teaching process can be avoided.
It is to be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, having an element defined by the phrase "comprising a … …" does not exclude the presence of another like element in a process, method, article, or apparatus that comprises the element.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement or the like made within the spirit and principle of the present application shall be included in the scope of the claims of the present application.

Claims (10)

1. A multi-terminal data synchronization method in multimedia teaching is characterized by comprising the following steps:
a first master control terminal sends a first master control instruction based on business logic to a server of a B/S framework through a browser website port;
the server sends execution service data to the first master control terminal according to the first master control instruction;
the first main control terminal executes service data based on the first main control instruction;
performing real-time network detection on the first master control terminal and the first controlled terminal;
when a real-time network between a first main control terminal and a first controlled terminal is smooth, so that the first main control terminal and the first controlled terminal have the same heartbeat packet parameters, a server sends execution service data to the first controlled terminal according to a first main control instruction;
and the first controlled terminal executes the service data based on the first master control instruction.
2. The method of claim 1, wherein the method further comprises:
the method comprises the steps that a first main control terminal and a first controlled terminal establish a real-time network based on a Web Socket protocol;
the first main control terminal transmits heartbeat packet data with the first controlled terminal through a real-time network based on a Web Socket protocol.
3. The method of claim 1, wherein the server sends execution service data to the first controlled terminal according to the first master control instruction, and specifically includes:
the server records an operation event in the first master control instruction and a parameter describing the operation event;
and the server transmits the operation event and the parameters describing the operation event through a Web Socket protocol.
4. The method of claim 1, wherein the method is used to process animations in multimedia teaching.
5. A multi-terminal data synchronization method in multimedia teaching is characterized by comprising the following steps:
the second controlled terminal sends a data request to the server through a Web Socket protocol;
the method comprises the steps that a server reads a log which records an operation event of a first main control terminal and parameters describing the operation event;
when the first main control terminal is configured to be in a synchronous mode, real-time network detection is carried out on the first main control terminal and the first controlled terminal;
when a real-time network between the first main control terminal and the first controlled terminal is smooth, so that the first main control terminal and the first controlled terminal have the same heartbeat packet parameters, the server transmits the operation event and the parameters describing the operation event to the second controlled terminal through a Web Socket protocol;
and the second controlled terminal executes the operation event.
6. A multi-terminal data synchronization method in multimedia teaching is characterized by comprising the following steps:
the second controlled terminal sends a data request to the server through a Web Socket protocol;
the method comprises the steps that a server reads a log which records an operation event of a first main control terminal and parameters describing the operation event;
when the first main control terminal is configured to be in an asynchronous mode, the server transmits the operation event defined by default and parameters describing the operation event to the second controlled terminal through a Web Socket protocol;
and the second controlled terminal executes the operation event.
7. A multi-terminal data synchronization system in multimedia teaching is characterized in that the system is specifically used for:
the control instruction sending device is used for sending a first main control instruction based on business logic to a server of the B/S framework by the first main control terminal through a browser website port;
the control instruction response device is used for sending execution service data to the first main control terminal by the server according to the first main control instruction;
the execution device is used for the first main control terminal to execute the service data based on the first main control instruction;
the network detection device is used for carrying out real-time network detection on the first main control terminal and the first controlled terminal;
the control instruction response device is also used for sending execution service data to the first controlled terminal by the server according to the first main control instruction when the real-time network between the first main control terminal and the first controlled terminal is smooth so that the first main control terminal and the first controlled terminal have the same heartbeat packet parameters;
the executing device is further configured to execute, by the first controlled terminal, the service data based on the first master control instruction.
8. The system of claim 7, wherein the system is further configured to:
the first master control terminal and the first controlled terminal establish a real-time network based on a Web Socket protocol;
the first main control terminal transmits heartbeat packet data with the first controlled terminal through a real-time network based on a Web Socket protocol.
9. The system of claim 7, wherein the server sends the execution service data to the first controlled terminal according to the first master control instruction, and is specifically configured to:
the server records an operation event in the first master control instruction and a parameter describing the operation event;
and the server transmits the operation event and the parameters describing the operation event through a Web Socket protocol.
10. The system of claim 7, wherein the system is configured to process animations in multimedia teaching.
CN202310043288.XA 2023-01-29 2023-01-29 Multi-terminal data synchronization method and system in multimedia teaching Pending CN115883524A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310043288.XA CN115883524A (en) 2023-01-29 2023-01-29 Multi-terminal data synchronization method and system in multimedia teaching

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310043288.XA CN115883524A (en) 2023-01-29 2023-01-29 Multi-terminal data synchronization method and system in multimedia teaching

Publications (1)

Publication Number Publication Date
CN115883524A true CN115883524A (en) 2023-03-31

Family

ID=85758514

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310043288.XA Pending CN115883524A (en) 2023-01-29 2023-01-29 Multi-terminal data synchronization method and system in multimedia teaching

Country Status (1)

Country Link
CN (1) CN115883524A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006077283A1 (en) * 2005-01-20 2006-07-27 Stream Mobile Oy Push messaging commanded methods and devices
CN201742446U (en) * 2010-08-26 2011-02-09 苏州彭华信息技术有限公司 Automatic starting up or awakening set-top box
CN104093077A (en) * 2013-10-29 2014-10-08 腾讯科技(深圳)有限公司 Multi terminal interconnection method, device and system
CN105807651A (en) * 2016-03-03 2016-07-27 腾讯科技(深圳)有限公司 Remote terminal controlling method, apparatus and system
CN107426233A (en) * 2017-08-08 2017-12-01 深圳先进技术研究院 Data communication system, method, Web server and monitoring system based on B/S frameworks
CN108616584A (en) * 2018-04-19 2018-10-02 华南师范大学 A kind of wisdom classroom collecting method and system based on xAPI

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006077283A1 (en) * 2005-01-20 2006-07-27 Stream Mobile Oy Push messaging commanded methods and devices
CN201742446U (en) * 2010-08-26 2011-02-09 苏州彭华信息技术有限公司 Automatic starting up or awakening set-top box
CN104093077A (en) * 2013-10-29 2014-10-08 腾讯科技(深圳)有限公司 Multi terminal interconnection method, device and system
CN105807651A (en) * 2016-03-03 2016-07-27 腾讯科技(深圳)有限公司 Remote terminal controlling method, apparatus and system
CN107426233A (en) * 2017-08-08 2017-12-01 深圳先进技术研究院 Data communication system, method, Web server and monitoring system based on B/S frameworks
CN108616584A (en) * 2018-04-19 2018-10-02 华南师范大学 A kind of wisdom classroom collecting method and system based on xAPI

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
张会汀,郑力明,闵宇: "构建基于Internet远程实时多媒体教学系统", 电子技术 *
曾柏羲;宋鸿陟;司国东;: "基于B/S结构的多终端交互式幻灯片演示系统", 现代电子技术 *

Similar Documents

Publication Publication Date Title
EP3883254A1 (en) Method and apparatus for synchronizing whiteboard with video, computing device, and storage medium
CN109981711B (en) Document dynamic playing method, device and system and computer readable storage medium
CN108173946B (en) Method, system and related method for realizing real-time classroom interaction
CN110535871B (en) WebRTC-based classroom real-time video projection method and system
EP3055761B1 (en) Framework for screen content sharing system with generalized screen descriptions
JP2006101522A (en) Video conference system, video conference system for enabling participant to customize cooperation work model, and method for controlling mixing of data stream for video conference session
CN111918080B (en) Live lecture processing method and device
CN111723558A (en) Document display method and device, electronic equipment and storage medium
CN113868573A (en) Method and system for quickly establishing one-screen interaction based on webpage
WO2022111421A1 (en) Screen projection method and apparatus for application interface, device, and storage medium
CN112866619B (en) Teleconference control method and device, electronic equipment and storage medium
CN110620953A (en) Multi-screen interaction method, device and system
US20150195320A1 (en) Method, System and Software Product for Improved Online Multimedia File Sharing
WO2015180446A1 (en) System and method for maintaining connection channel in multi-device interworking service
JP4292998B2 (en) Synchronization control method, communication synchronization control device, and bidirectional communication system
CN113868575A (en) Webpage same-screen method and system
CN115883524A (en) Multi-terminal data synchronization method and system in multimedia teaching
CN107195211B (en) Bypass-based on-line lesson monitoring system
KR20200050774A (en) HTML5-based web-responsive content interactive social learning system
Maly et al. IRI-h, a Java-based distance education system: architecture and performance
WO2014158634A1 (en) Generating an image stream
CN111768666B (en) Method and terminal for interacting online classroom
Pandusadewa et al. Development of conversation application as english learning using WebRTC
CN111813312B (en) Data transmission method, device, system, terminal equipment and readable storage medium
KR20200011299A (en) Method for providing interactive contents including screen, sound, and mouse pointer sharing service for e-sports education

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination