TWI760635B - Remote real-time multimedia teaching method, device and system, electronic equipment and computer-readable recording medium - Google Patents

Abstract

A remote real-time multimedia teaching method, comprising, in response to receiving a course request of at least a first type of account and a second type of account, establishing a virtual interactive space associated with the first type of account and the second type of account, and reporting to the third type of account. The first type of account and the second type of account provide cloud desktop; in response to the operation instruction of the second type of account, operate the cloud desktop; in response to the first permission instruction of the second type of account to the first type of account, make the first type of account The type account is changed from the first type of permission to the second type of permission; in response to the operation instruction of the first type of account with the second type of permission, the cloud desktop is operated; in response to the second type of account to the first type of account The second permission instruction makes the first type of account change from the second type of permission to the first type of permission.

Description

Remote real-time multimedia teaching method, device and system, electronic equipment and computer-readable recording medium

The present invention relates to the field of computer application, in particular to a remote real-time multimedia teaching method, device and system, electronic equipment and a computer-readable recording medium.

With the rapid development of information technology, especially from the Internet to the mobile Internet, the way of living, working and learning across time and space has been created, and the way of knowledge acquisition has undergone fundamental changes. Teaching and learning can be independent of time, space and location conditions. Restrictions, flexible and diversified channels for knowledge acquisition, make online education born. As the name implies, online education is a teaching method with the network as the medium. Through the network, students and teachers can carry out teaching activities even if they are separated by thousands of miles; in addition, with the help of online courseware, students can also learn anytime, anywhere, which really breaks the time and time. Due to the limitation of space, online remote education is the most convenient way of learning for those who are busy with work and have irregular study time. Online education is mainly through the application of information technology and Internet technology for content dissemination and rapid learning methods to achieve electronic learning, efficient learning, exploratory learning, experiential learning, extended learning, extended learning, and easy-to-use learning. Learning, enhanced learning.

However, in the course, on the one hand, there is no effective means of permission management and control to optimize the interactive process in instant teaching. On the other hand, in order to achieve real-time interactive operation between teachers and students, rather than teachers who can only watch the explanation of the course content, but cannot see the operation process of students, virtualization solutions are mostly used. But the current virtualization technology has a series of problems, such as the need to install additional plug-ins before learning to achieve the effect. These plug-ins often require professionals to guide the installation, and in the face of complex network settings and firewalls, they cannot directly penetrate the network to achieve connection. At the same time, additional plug-ins will result in lower performance and lower remote desktop connection quality. In addition, in the case of large-scale users, it is not convenient to manage and close the remote desktop.

Therefore, in order to overcome the above-mentioned defects of the related art, the present invention provides a remote real-time multimedia teaching method, device, electronic device and computer-readable recording medium, thereby at least to a certain extent overcome the limitations and defects of the related art. cause one or more problems.

Therefore, a remote real-time multimedia teaching method of the present invention includes: a control system responding to a course request from a first terminal device corresponding to at least one first-type account and a second terminal device corresponding to a second-type account , establishes a virtual interactive space associated with the at least one first-type account and a second-type account; the control system provides a cloud desktop to the at least one first-type account and the second-type account in the virtual interactive space , wherein, the first type of account has the first type of permission, the first type of permission does not allow the operation of the cloud desktop, the second type of account has the second type of permission, the second type of permission right to operate the cloud desktop; the control system responds to the operation instruction of the second type of account to operate the cloud desktop; the control system responds to the first permission instruction of the second type of account to the first type of account , so that the first-type account corresponding to the first permission instruction is changed from the first-type permission to the second-type permission; the control system responds to the operation instruction of the first-type account with the second-type permission, and operates the the cloud desktop; and the control system responds to the second permission instruction of the second type of account to the first type of account, so that the first type of account corresponding to the second permission instruction is changed from the second type of permission to the first type of account A class of permissions.

In some implementation aspects of the present invention, after the establishing a virtual interactive space associated with the at least one first type of account and the second type of account, the method further includes: the control system reporting to at least one first one in the virtual interactive space The class account provides second multimedia data of the second class account, and the second multimedia data is displayed in the cloud desktop or independently of the cloud desktop.

In some implementation aspects of the present invention, after the establishing a virtual interactive space associated with the at least one first type of account and the second type of account, the control system further includes: the control system responds to the second type of account to the first type of account. the first control instruction of a class account, and receive the first multimedia data of the first class account corresponding to the first control command; the control system provides the second class account in the virtual interactive space with the information of the first class account first multimedia data, and the first multimedia data is displayed in the cloud desktop or independently of the cloud desktop; and the control system responds to the second type of account to the first type of account The second control instruction is to stop receiving the first multimedia data of the first type of account corresponding to the first control instruction.

In some implementation aspects of the present invention, the first control instruction and the second control instruction control the multimedia collection device of the first terminal device corresponding to the first type of account.

In some implementation aspects of the present invention, the first permission instruction triggers the first control instruction; the second permission instruction triggers the second control instruction.

In some implementation aspects of the present invention, the control system triggers the second type of account to generate a first permission instruction for the first type of account in response to the action instruction of the first type of account.

In some implementation aspects of the present invention, the action instruction is generated when the first terminal device corresponding to the first type of account recognizes a preset first action based on a video capture device corresponding to the first type of account .

In some implementation aspects of the present invention, the action instruction is generated when the first terminal device corresponding to the first type of account recognizes a preset first action based on a wearable device corresponding to the first type of account.

In some implementation aspects of the present invention, the control system causes the virtual interactive space to associate a management account with the management account in response to a request instruction of the first type of account and/or the second type of account in the virtual interactive space. Corresponding to a management terminal device and having a third type of permission, the third type of permission allows the management account to change the association of the virtual interactive space with the first type of account and/or the second type of account, and allows the management The account modifies the permission of the first type of account and/or the second type of account, and allows the management account to operate the cloud desktop.

Furthermore, a remote real-time multimedia teaching device for implementing the above method according to the present invention includes: a building module, in response to receiving a course request of at least one first-type account and one second-type account, establishing a relationship with the at least one account. a virtual interactive space for a first-type account and a second-type account; a providing module provides cloud desktops to at least one first-type account and a second-type account in the virtual interactive space, wherein the first-type account The account has the first type of permission, the first type of permission does not allow the first type of account to operate the cloud desktop, the second type of account has the second type of permission, the second type of permission allows The second type of account operates the cloud desktop; a first operation module responds to the operation instruction of the second type of account to operate the cloud desktop; a first modification module responds to the second The first permission instruction of the class account to the first class account, so that the first class account corresponding to the first permission command is changed from the first class permission to the second class permission; a second operation module, responding to The operation instruction of the first-type account with the second-type permission is to operate the cloud desktop; and a second modification module, in response to the second permission instruction of the second-type account to the first-type account, causes the cloud desktop to be operated. The first-type account corresponding to the second permission instruction is changed from the second-type permission to the first-type permission.

In addition, the present invention provides a remote real-time multimedia teaching system for implementing the above method, including a plurality of terminal devices and a control system. When the terminal device is logged in with a first type of account, it is used as a first terminal device, and when the terminal device is logged in with a second type of account, it is used as a second terminal device. The control system is used for establishing a virtual interactive space associated with the at least one first terminal device and a second terminal device according to a course request, and controlling the interaction between the first terminal device and the second terminal device in the virtual interactive space, and includes: : a communication module for communicating with each terminal device; a cloud desktop module for providing a cloud desktop to at least one first terminal device and the second terminal device in the virtual interactive space, and responding to each An operation instruction of a class account to operate the cloud desktop; a permission management module for managing the permissions of various accounts, wherein the permission management module responds to the second class account for the first class account. The first permission instruction of the account, so that the first type of account corresponding to the first permission instruction is changed from the first type of permission to the second type of permission, and the permission management module responds to the second type of account For the second permission instruction of the first type of account, the first type of account corresponding to the second permission instruction is changed from the second type of permission to the first type of permission, and the first type of permission does not allow any operation. the cloud desktop, and the second type of permission operates the cloud desktop.

In some implementation aspects of the present invention, the terminal device communicates with the cloud desktop module through websocket; the terminal device communicates with the communication module through webRTC.

In some implementation aspects of the present invention, the cloud desktop module is implemented based on a browser.

In addition, an electronic device implementing the above method according to the present invention includes a processor and a memory. A computer program is stored in the memory, and when the computer program is run by the processor, the above-mentioned remote real-time multimedia teaching method is executed.

In addition, the present invention implements a computer-readable recording medium for implementing the above-mentioned method, wherein the computer-readable recording medium stores a computer program, and the computer program can execute the above-mentioned operation when the computer program is run by a processor of a terminal device. Remote real-time multimedia teaching method.

The effects of the present invention are: on the one hand, the present invention can provide a cloud desktop to an account located in the virtual interactive space through the establishment of a virtual interactive space, and the cloud desktop can be operated according to different account permissions to realize interaction in the virtual interactive space On the other hand, the present invention allows the second type of account to change the permission of the first type of account through the permission association between the accounts, so as to manage the interaction in the course in an orderly manner; on the other hand, the present invention does not require The plug-in can provide cloud desktop and multimedia interaction, solving the problem of installing additional plug-ins and complex networks during the virtualization process.

Before the present invention is described in detail, it should be noted that in the following description, similar elements are designated by the same reference numerals.

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments, however, can be embodied in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

Furthermore, the drawings are merely schematic illustrations of the invention and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repeated descriptions will be omitted. Some of the block diagrams shown in the figures are functional entities that do not necessarily necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different network and/or processor devices and/or microcontroller devices these functional entities.

The flow charts shown in the figures are merely illustrative and do not necessarily include all steps. For example, some steps can be decomposed, and some steps can be combined or partially combined, so the actual execution order may be changed according to the actual situation.

FIG. 1 shows a flowchart of an embodiment of the remote real-time multimedia teaching method of the present invention. The remote real-time multimedia teaching method of this embodiment includes the following steps: Step S110 : a control system, in response to receiving a course request for at least one first-type account and a second-type account, establishes an association with the at least one first-type account and the A virtual interactive space for the second type of account.

Specifically, the first type of account is a student account and corresponds to a first terminal device (a student-side computer device). The second type of account is a teacher account and corresponds to a second terminal device (a teacher's computer device). For convenience of description, the first type of account described below represents the first terminal device, and the second type of account described below represents the second terminal device. The virtual interactive space is, for example, an online classroom. In the online classroom, at least the students who log in with the student account are shown the live/recorded teaching video course of the classroom logged in with the teacher account and the courseware of the course (the teaching content that uses the computer to present the text and graphics of the teaching content in multimedia form). tool). In this online classroom, feedback from students can also be provided to teachers, thereby realizing real-time interaction, online problem solving, etc. The virtual interactive space provided in this embodiment is not limited to this.

Specifically, step S110 establishing a virtual interactive space according to at least one first-type account and one second-type account may further include the following steps: generating a unique identification code of the virtual interactive space, maintaining the at least one first-type account and a mapping table (mapping table) between the second type of account and the unique identification code of the virtual interactive space. Thus, this embodiment can maintain the mapping and connection status of student accounts and teacher accounts in multiple virtual interactive spaces (multiple online classrooms).

Step S120: The control system provides a cloud desktop to at least one first-type account and one second-type account in the virtual interactive space, wherein the first-type account has the first-type permission, and the first-type permission The right does not allow the operation of the cloud desktop, the second type of account has the second type of permission, and the second type of permission allows the operation of the cloud desktop.

Specifically, the cloud desktop is based on a unique communication protocol, and the desktop or application is redirected and released to the operator through the cloud terminal. As the carrier for realizing the cloud desktop, the cloud terminal functions to present the cloud desktop on the front end, and its main function is to display the cloud desktop and redirect the terminal output and input data to the cloud server.

In some embodiments, the cloud desktops displayed to the first type of account and the second type of account are identical. In other embodiments, the cloud desktops displayed to the first type of account and the second type of account are different, and have personalization (customization) customization according to different types of accounts. In this embodiment, the personalized display can be displayed in The terminal logged in with the account adjusts the cloud desktop provided by the cloud, and can also adjust when the cloud desktop is generated in the cloud, but this embodiment is not limited thereto.

Further, step S120 indicates that in the initial state, the second type of account has the permission to operate the cloud desktop, while the first type of account does not have the permission to operate the cloud desktop.

Step S130: The control system operates the cloud desktop in response to the operation instruction of the second type of account.

Specifically, the operation instruction may include any operation on the cloud desktop, such as inputting data, modifying data, adjusting the size of the display interface, opening applications, switching applications, etc., which is not limited in this embodiment. After the cloud desktop is operated in response to the operation instruction of the second type of account, its update is also displayed to the first type of account and the second type of account accordingly.

Step S140: The control system responds to the first permission instruction of the second type of account to the first type of account, so that the first type of account corresponding to the first permission instruction is changed from the first type of permission to the second type permission.

Specifically, when the second type of account needs to interact with the first type of account, the first permission instruction can be actively generated, so that the first type of account has the second type of permission to operate the cloud desktop.

In some specific embodiments, when the control system recognizes that the first type of account has interactive requirements for the cloud desktop, it can also generate prompt information to the second type of account, so that the second type of account can trigger the first type of account according to the prompt information. Generation of permission directives. The control system can identify whether the first type of account has an interaction requirement according to the video recognition of the first type of account, the action recognition of the wearable device, or whether the first type of account has clicked an interactive option.

In some specific embodiments, the first permission instruction enables the first type of account to have part of the second type of permission to operate the cloud desktop. In other words, the first permission instruction enables the first type of account to operate only part of the display area of the cloud desktop/part of the application of the cloud desktop, etc., which is not a limitation in this embodiment.

Step S150: The control system operates the cloud desktop in response to the operation instruction of the first-type account with the second-type permission.

After the permission of the first type of account is changed to have the second type of permission, the first type of account can operate the cloud desktop. The operation instruction may include any operation on the cloud desktop, such as inputting data, modifying data, adjusting the size of the display interface, opening applications, switching applications, etc., which is not limited in the present invention. After the cloud desktop is operated in response to the operation instruction of the first type of account, the update thereof is also correspondingly displayed to the first type of account and the second type of account.

Step S160: The control system responds to the second permission instruction of the second type of account to the first type of account, so that the first type of account corresponding to the second permission instruction is changed from the second type of permission to the first type permission.

Specifically, after the interaction between the second-type account and the first-type account on the cloud desktop is completed, the second permission instruction may be actively generated, so that the first-type account has the first-type permission that cannot operate the cloud desktop. In this way, it is possible to prevent the first type of account from affecting the lecture of the second type of account during the course.

In the remote instant multimedia teaching method provided by this embodiment, on the one hand, the present invention can provide a cloud desktop to an account located in the virtual interactive space by establishing a virtual interactive space, and the cloud desktop can be operated according to different account permissions, In order to realize the interaction in the virtual interactive space; on the other hand, the present invention allows the second type of account to change the permission of the first type of account through the permission association between the accounts, so as to manage the interaction in the course in an orderly manner On the other hand, the present invention can provide cloud desktop and multimedia interaction without plug-in programs, and solve the problem of installing additional plug-in programs and complex networks in the virtualization process.

In a specific embodiment of the present invention, after the step S110 establishes a virtual interactive space associated with the at least one first-type account and a second-type account, the control system may further include: sending the control system to the virtual interactive space At least one first type of account provides second multimedia data of the second type of account, and the second multimedia data is displayed in the cloud desktop or displayed independently of the cloud desktop.

Specifically, the second multimedia material may include audio material and video material. The second multimedia material can be displayed to the first type of account and the second type of account independently of the cloud desktop. In other embodiments, the second multimedia material is embedded in the cloud desktop and displayed to the first type of account and the second type of account. The present invention is not limited by this.

As shown in FIG. 2 , FIG. 2 shows a schematic diagram of a cloud desktop according to a specific embodiment of the present invention. Specifically, the display interface 200 includes a cloud desktop 201 , a teacher video area 202 , student video areas 203 and 204 , and a discussion area 205 . The display interface 200 only schematically shows the display interface in the virtual interactive space, and the arrangement, size and setting of each area are not limited by this. For example, in the interface of the student account, the student video areas 203 and 204 can be omitted. Or only the video area of the student's account is displayed; in the display interface of the teacher's account, the teacher's video area 202 can be omitted, and the present invention can also implement more variations, which will not be repeated here.

In other embodiments, the teacher video area 202 , the student video areas 203 and 204 , and the discussion area 205 may be embedded in the cloud desktop 201 .

In a specific embodiment of the present invention, as shown in FIG. 3 , after the step S110 establishes a virtual interactive space associated with the at least one first-type account and one second-type account, it may further include:

Step S171: In response to the first control instruction of the second type of account on the first type of account, the control system receives the first multimedia data of the first type of account corresponding to the first control instruction.

Step S172: The control system provides the first multimedia data of the first type of account to the second type of account in the virtual interactive space, and the first multimedia data is displayed in the cloud desktop or is independent of all the accounts. The cloud desktop display described above.

Step S273: In response to the second control instruction of the second type of account on the first type of account, the control system stops receiving the first multimedia data of the first type of account corresponding to the first control instruction.

Specifically, when the second type of account needs to perform audio and video interaction with the first type of account, the first control instruction can be actively generated to receive the first multimedia of the first type of account corresponding to the first control instruction material.

In some specific embodiments, when the control system recognizes that the first type of account has audio and video interaction requirements, it can also generate prompt information to the second type of account, so that the second type of account can trigger the first control instruction according to the prompt information. generation. Whether the first type of account has audio and video interaction requirements can be identified according to the video recognition of the first type of account, the action recognition of the wearable device, or whether the first type of account has clicked the interactive option.

The first multimedia data of the first type of account can be displayed to the first type of account and the second type of account independently of the cloud desktop. In other embodiments, the first multimedia material is embedded in the cloud desktop and displayed to the first type of account and the second type of account. The present invention is not limited by this.

Specifically, after the audio and video interaction between the second-type account and the first-type account is completed, the second control instruction may be actively generated to stop receiving the first multimedia of the first-type account corresponding to the first control instruction body information. In this way, it is possible to prevent the first type of account from affecting the lecture of the second type of account during the course. Further, the load of data transmission can also be reduced.

In the foregoing embodiment, the first control instruction and the second control instruction control the multimedia collection device of the client (ie, the first terminal device) where the first type of account is located. In other words, the first control instruction can control the opening of the multimedia collection device at the user end where the first type of account is located, so that the first multimedia data of the first type of account can be received; the second control instruction can control the multimedia data of the user end where the first type of account is located The collection device is turned off, so that the first multimedia data of the first type of account can be stopped. The multimedia collection device may include a camera, a microphone, etc., and the present invention is not limited thereto.

In one of the foregoing embodiments, the first permission instruction triggers the first control instruction; the second permission instruction triggers the second control instruction. In other words, when the first permission instruction is generated, the generation of the first control instruction is automatically triggered, so that the first type of account can operate the cloud desktop while interacting with audio and video; when the second permission instruction is generated, the generation of the first control instruction is automatically triggered. The second control instruction is used, so that the first type of account stops operating the cloud desktop and stops audio and video interaction at the same time.

In the aforementioned another embodiment, the first permission instruction, the second permission instruction, the first control instruction, and the second control instruction are independent instructions that are triggered based on independent events.

In some specific embodiments, the account of the first type triggers the account of the second type to generate a first permission instruction for the account of the first type in response to the action instruction of the account of the first type. The action instruction may be generated when the video capture device of the first type of account recognizes a preset first action. The action instruction may also be generated when the wearable device of the first type of account recognizes a preset first action. The first action is, for example, an action of raising a hand, thereby imitating the scene of a real classroom. Specifically, the video recognition can, for example, identify the student's arm through the skeleton point, and judge whether the student's arm is a hand-raising action according to the movement of the skeleton point. In the course, the students generally have few movements, so the video capture device can realize the recognition of the raised hand movement without the need for a complex and accurate recognition algorithm. Specifically, according to the gyroscope that comes with the wearable device (such as a wristband), the student's hand movements can be recognized. Similarly, students generally have few movements. Therefore, the wearable device can realize lifting without complex and accurate recognition algorithms. Recognition of hand movements. Further, when identifying the action instruction of the first type of account, the control system can provide prompt information to the second type of account, so that the second type of account can generate the first permission instruction based on it. In other embodiments, when the action instruction of the first type of account is identified, the control system may also automatically trigger the second type of account to provide the first permission instruction.

Further, the first control instruction may be triggered in the same manner, for example, the triggering is performed in response to an action instruction of the second action of the first type of account. For example, the second action may be a different action from the first action (for example, the first action is raising the right hand, and the second action is raising the left hand), which is not a limitation of the present invention.

In some embodiments of the present invention, the control system responds to the request instruction of the first type of account and/or the second type of account in the virtual interactive space, and associates the virtual interactive space with a management account, and the management account corresponds to a management account. For the convenience of description, the management account referred to below represents the management device. The management account has a third type of permission, which allows the management account to change the association of the virtual interactive space with the first type of account and/or the second type of account, allows the management account to modify The permission of the first type of account and/or the second type of account allows the management account to operate the cloud desktop.

In this embodiment, taking into account the unexpected situation that may occur during the course, the management account can enter the virtual interactive space for management and adjustment.

The steps of the remote real-time multimedia teaching method of the present invention are described above. On the premise of not violating the concept of the present invention, the splitting and merging of each step, the sequence change, and the synchronous and asynchronous execution are all within the protection scope of the present invention.

The above has schematically described multiple implementations of the remote instant multimedia teaching method of the present invention, and the multiple implementations may be implemented individually or in combination, and the present invention is not limited thereto.

4 and 5, FIG. 4 shows a schematic diagram of an embodiment of a remote real-time multimedia teaching system of the present invention; FIG. 5 shows a schematic diagram of a specific embodiment of a module block included in the control system in FIG. 4 .

The remote real-time multimedia teaching system in this embodiment includes a plurality of terminal devices 310 and 320 and a control system 330 . When the terminal device is logged in with a first type of account, it is used as the first terminal device 310 , and when the terminal device is logged in with a second type of account, it is used as the second terminal device 320 . The first terminal device 310 and the second terminal device 320 respectively include a first multimedia collection module 311 and a second multimedia collection module 321 .

The control system 330 is configured to establish a virtual interactive space associated with the at least one first terminal device 310 and a second terminal device 320 according to the course request, and control the interaction between the first terminal device 310 and the second terminal device 320 in the virtual interactive space. interactive. The control system 330 includes a communication module 331 and a cloud desktop module 333 . The communication module 331 is used to communicate with each terminal device. The cloud desktop module 333 is used to provide a cloud desktop to at least one first terminal device 310 and a second terminal device 320 in the virtual interactive space, and operate the cloud desktop in response to operation instructions of various accounts. The control system 330 may also include a permissions management module 332 . The permission management module 332 is used to manage the permissions of various types of accounts, wherein the permission management module 332 responds to the second type of account (the second terminal device 320 ) to the first type of account (the first terminal device 320 ). The first permission instruction of the device 310), so that the first type of account corresponding to the first permission instruction is changed from the first type of permission to the second type of permission, and the permission management module 332 responds to the first The second permission instruction of the second category account to the first category account, so that the first category account corresponding to the second permission instruction is changed from the second category permission to the first category permission, and the first category permission does not The cloud desktop is allowed to operate, and the second type of permission allows the cloud desktop to be operated. The terminal device includes a multimedia collection device (that is, the above-mentioned multimedia collection module), and the control system 330 may also include a multimedia control module, and the multimedia control module is used to respond to the second type of account to the first type of account. The control instruction is used to control the multimedia collection device of the terminal equipment corresponding to the first type of account.

Specifically, the remote real-time multimedia teaching system provided in this embodiment can support individual control and sharing of a single first-type account (the first terminal device 310 ). Between the first terminal device 310 and the second terminal device 320 and the control system 330, the bottom layer protocol is connected through TCP, and the upper layer protocol uses WebRTC to realize instant communication and signaling distribution. The first terminal device 310 and the second terminal device 320 accept the signaling control of the control system 330 and apply for the permission of the local first multimedia collection module 311 and the second multimedia collection module 321 to realize local audio and video Sending and receiving of materials and other teaching-related materials; the first terminal device 310 and the second terminal device 320, after receiving the authorization from the control system 330, accept the audio and video sent by other terminal devices. The control system 330 controls access (connection), registration and disconnection (disconnection) of terminal devices, allocation and creation of cloud desktops, and permission control.

The first terminal device 310 and the second terminal device 320 are connected to the control system 330 through the network, perform status and information exchange and interaction, and send responses according to their exchange and interaction results, control and play audio and video, and realize animation and special effects playback. In this embodiment, the second terminal device 320 can control the functions of the first terminal device 310 through the control system 330 (for example, whiteboard, turn on the microphone (also called microphone), play video, etc.), so as to realize the orderly and smooth progress of the classroom communicate.

The control system 330 may be responsible for user authentication, resource configuration and signaling distribution, delivery and processing. Connect to all terminal devices through TCP protocol and HTTP service calls; save relevant logs for third-party system analysis, improve system performance, and deal with system problems; store system-related description requests to the database for easy retrospection and customer return visits.

In the specific implementation of the present invention, the remote real-time multimedia teaching system of this embodiment is a cloud desktop system that supports real-time control, interaction and communication of multiple people. Physical distribution can be divided into a first terminal device 310 , a second terminal device 320 and a control system 330 . The first terminal device 310 and the second terminal device 320 are respectively connected and registered to the control system 330 . The control system 330 centrally schedules various permissions of the first terminal device 310 and the second terminal device 320, and activates the corresponding resources to open the virtual interactive space. After the virtual interactive space is established, the control system 330 can select different communication modes. For example, the control system 330 may select a relay mode, and the control system 330 passes both requests and traffic. For another example, the control system 330 can select the P2P mode, the main data is not passed through the control system 330, but is transmitted between the first terminal device 310 and the second terminal device 320, and the control system 330 only transmits some control commands.

In some specific implementations of the present invention, in addition to the first type of account and the second type of account, a management account (corresponding to a management terminal device) may also be included. Specifically, the second type of account as the teacher account can control the camera and microphone permissions of the first type of account as the student account, and by switching the first terminal device 310 of the student account to ensure that each student has the opportunity to show himself, and communicate with teachers. For managing accounts, the control system 330 can enter the virtual interactive space in a specific way, check the current account list, refresh the status, switch teacher accounts, check the overall system operation status, etc., to ensure that the course can go on smoothly; through the control system 330, The first type of account and the second type of account send a request instruction to request the management account to enter the virtual interactive space for viewing, and assist in handling the abnormal situation.

In some specific implementations of the present invention, the control system 330 includes a communication module 331 , a license management module 332 , and a cloud desktop module 333 . The communication module 331 of the control system 330 respectively calls and notifies the first terminal device 310 and the second terminal device 320 through WebRTC (Web Real-Time Communication); the cloud desktop module 333 serves the A terminal device 310, a second terminal device 320; the permission management module 332 controls the permissions between the first terminal device 310, the second terminal device 320 and the cloud desktop module 333, and realizes the first type of account and the second type of account Account control flow. The control system 330 mainly controls the communication and interaction process of the first terminal device 310, the second terminal device 320 and the cloud desktop, including the first terminal device 310 and the second terminal device 320 after successfully logging in through the control system 330, through the Peer of WebRTC. 2. Establish instant communication and communication in a peer-to-peer (peer-to-peer) manner, and accept instructions from the control system 330 to control local audio and video, chat information and cloud desktop operations; after the connection is established, the second terminal device 320 can open the cloud desktop module 333. The student client (ie, the first terminal device 310 ) is invited to join, and the permission management module 332 manages the permission to realize one-to-many communication.

In some specific implementations of the present invention, the terminal devices (the first terminal device 310, the second terminal device 320) are composed of a permission control system module, an audio and video processing module, an instant messaging processing module, a cloud desktop processing module and The management module consists of five parts. The management module connects with other modules through messages and callbacks, and coordinates and controls all other modules to form a unified whole. The management module is connected to the control system 330 through a WebSocket long connection, establishes a connection, transmits data, exchanges control signaling, and transmits messages to other modules in a timely manner; the main function of the audio and video processing module is to control audio and video playback, and also needs to communicate with The local multimedia acquisition module is connected, reads video and audio through the WebRTC framework, and transmits the audio and video data to other terminal devices according to the encoder when the WebRTC connection was created; the main function of the cloud desktop processing module is to respond to the cloud desktop and accept the server to transmit various Control signaling, transmit feedback signaling to the control system 330, and respond to cloud desktop operations to other users; the main work content of the instant messaging processing module includes the transmission and decoding of chat content, refresh various messages and page frames, and obtain the latest status; permission The main work content of the control system module is to obtain the permission list based on the current logged-in user connecting to the back-end permission control system, and can perform effective control, apply for permission, refresh permission and other related operations, and can set different permissions according to different roles. Permission to display different content and operation interface. Terminal devices can be divided into multiple platforms such as iOS, Android, PC and Html5 from the support platform, which supports users to learn and share in class anytime and anywhere.

In some specific implementations of the present invention, the cloud desktop module 333 of the control system 330 can operate a virtual machine through a browser, which is suitable for mainstream browsers such as Chrome, Firefox, and IE9+, and can realize multi-user without additional installation of plug-ins. Remote desktop access and control.

The cloud desktop module 333 may include the following main components: cloud desktop engine, client display terminal, account manager and resource manager. In actual use, in order to avoid resource exhaustion and achieve resource control, all instances and resources of the server are managed globally through the resource manager, and machines can be added in time to expand the server cluster to ensure high service availability; the account manager is It is used to control and create accounts, manage and record login/logout operations, realize automatic login of certain accounts, and further improve user experience through subsequent log analysis.

The cloud desktop engine is the core component of the cloud desktop module 333. It has the following advantages. It is completely based on the browser, does not need to install JRE, RDP, VNC and other client plug-ins, does not need to consider the customer's machine environment, and supports a variety of protocols; It can manage multiple servers through one authorized machine, avoiding multiple management terminal logins; it can penetrate the firewall and manage other devices that do not provide external network services through one server; HTML5-based remote desktop control framework, High performance.

The account manager of the cloud desktop module 333 is used for verification and support for login/logout and other related operations. It can be integrated with the third-party system, and the account information of students and teachers can be added in advance through the third-party system to ensure that teachers and students can Log in to the cloud desktop successfully. Through the account manager, you can count and query related user login information, user login time length, user login geographic location and other related information. Improve user accurate information push.

The resource manager of the cloud desktop module 333 is used for global resource management. Remote desktops can be created and closed through the resource manager, and remote desktops can be kicked out or closed in some emergency situations to ensure the quality of instant interaction. The introduction of centralized resource management can effectively improve the high availability of services.

In some specific implementations of the present invention, the communication module 331 of the control system 330 is a standard implementation of the WebRTC technology, thereby realizing audio and video communication and exchange. WebRTC (web instant communication technology) is simply the introduction of instant messaging in web browsers, including audio and video calls, etc., without plug-ins to realize the ability of instant messaging on the web side, and supports cross-platform, including linux, windows, mac, android, etc. , WebRTC only stipulates the API implementation of browser manufacturers, and does not make specific regulations for the way of instant messaging. To start a WebRTC session during the instant messaging process, the usual creation process is as follows: (1) The first terminal device 310 and the second terminal device 320 create an RTCPeerConnection object; (2) The first terminal device 310 and the second terminal device 320 create a processing routine for the icecandidate event; (3) The first terminal device 310 and the second terminal device 320 establish a processing routine for tracking events. When the first terminal device 310 and the second terminal device 320 add audio and video to the stream (message stream, message stream), the event be received; (4) Create and receive unique identifiers or tokens so that calls between them can be identified by a code on the backend server; (5) The first terminal device 310 and the second terminal device 320 are connected to an agreed back-end server to exchange messages with them, join the same WebRTC session (scepter identifier), and obtain descriptions, candidate addresses, etc.; (6) A connection is established between the first terminal device 310 and the second terminal device 320, and various control commands can be transmitted point-to-point to realize instant communication.

After the WebRTC session connection is established, the first terminal device 310, the second terminal device 320 and the control system 330 can transmit signaling to realize more functions, such as whiteboard, cloud desktop sharing and other functions, and the control system 330 will record the establishment process during the creation process. After the identification word or scepter is identified, follow-up operations are performed and linked to other system linkages.

In some specific implementations of the present invention, the permission management module 332 of the control system 330 can control the permissions possessed by each user in the system, such as whether to create a shared cloud desktop, and whether to enter a certain virtual interactive space. The permission control can avoid the risk of misoperation and improve the availability of the system. In the permission management module 332, management is performed based on the account type, and functions are opened and controlled for the account type. The account types in the permission management module 332 can be divided into first-type accounts, second-type accounts, management accounts, and other types of accounts, such as parent accounts and sales accounts. The second type of account sends signaling to the first type of account to control the progress and experience in a unified manner; the management account is used to receive business feedback, deal with problems, and view video files and other post-processing methods to further improve the user experience. Class accounts can directly give feedback and ask for help; parent accounts can be implemented in some youth curriculum systems to know the learning progress through participation and audition, but they cannot participate in the course teaching communication; sales accounts only appear in certain types of courses , to absorb feedback in a timely manner and promote sales.

The permission management module 332 needs to connect with the permission control module of each terminal device, issue various permission lists, process the application for new permission by the terminal device, and then promptly respond to notify other terminal devices to process together.

Therefore, the remote real-time multimedia teaching system of the present invention can effectively improve the connection quality of large-scale users, and does not rely on any plug-in program, and solves the problem of installing additional plug-in programs and complex networks in the virtualization process. Through the cloud desktop real-time audio and video interactive online teaching system based on WebRTC technology, teachers and students avoid the course becoming PPT playback and commentary, promote classroom interaction and effectively improve teaching effect and learning efficiency.

Multiple implementations of the present invention are schematically described above, and the multiple implementations may be implemented individually or in combination, and the present invention is not limited thereto.

Referring next to FIG. 6 , FIG. 6 shows a block diagram of modules included in an embodiment of the remote instant multimedia teaching device of the present invention. The remote real-time multimedia teaching device 400 of this embodiment includes a creation module 410 , a provision module 420 , a first operation module 430 , a first modification module 440 , a second operation module 450 , and a second modification module 460 .

The establishment module 410 establishes a virtual interactive space associated with the at least one first type account and one second type account in response to receiving the course request of at least one first type account and one second type account.

The providing module 420 provides cloud desktops to at least one first-type account and one second-type account in the virtual interactive space, wherein the first-type account has the first-type permission, and the first-type permission does not. The first type of account is allowed to operate the cloud desktop, the second type of account has the second type of permission, and the second type of permission allows the second type of account to operate the cloud desktop.

The first operation module 430 operates the cloud desktop in response to the operation instruction of the second type of account.

The first change module 440 responds to the first permission instruction of the second type of account to the first type of account, so that the first type of account corresponding to the first permission instruction is changed from the first type of permission to the second type of account permission.

The second operation module 450 operates the cloud desktop in response to the operation instruction of the first type of account with the second type of permission.

The second change module 460 responds to the second permission instruction of the second type of account to the first type of account, so that the first type of account corresponding to the permission instruction is changed from the second type of permission to the first type of permission .

In the remote instant multimedia teaching device of the exemplary embodiment of the present invention, on the one hand, the present invention can provide a cloud desktop to an account located in the virtual interactive space by establishing a virtual interactive space, and the cloud desktop can be based on different account permissions. On the other hand, the present invention allows the second type of account to change the permission of the first type of account through the permission association between the accounts, so that the interaction in the course has a positive effect. order management; on the other hand, the present invention can provide cloud desktop and multimedia interaction without plug-in programs, and solve the problem of installing additional plug-in programs and complex networks in the virtualization process.

6 only schematically shows the remote real-time multimedia teaching device 400 provided by the present invention. On the premise of not violating the concept of the present invention, the splitting, merging and adding of modules are all within the protection scope of the present invention. The remote real-time multimedia teaching device 400 provided by the present invention can be implemented by software, hardware, firmware, plug-in programs and any combination thereof, and the present invention is not limited thereto.

In an exemplary embodiment of the present invention, a computer-readable recording medium is also provided, in which a computer program is stored, and when the program is executed by, for example, a processor, the remote real-time multimedia described in any one of the above-mentioned embodiments can be realized. The steps of the teaching method. In some possible implementations, aspects of the present invention may also be implemented in the form of a program product comprising program code for enabling the terminal when the program product is run on a terminal device The device executes the steps of the remote instant multimedia teaching method described in any one of the foregoing embodiments.

Referring to FIG. 7, there is shown an embodiment of a program product 700 for implementing the above method according to the present invention, which may adopt a compact disk-read only memory (CD-ROM) and include program codes, and may be stored in a terminal device such as a personal computer run on. However, the program product of the present invention is not limited thereto. In the present invention, the computer-readable recording medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. .

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a computer-readable recording medium. The computer-readable recording medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples (non-exhaustive list) of computer-readable recording media include: electrical connections having one or more conductors, compact disks, hard disks, random access memory (RAM), read-only Memory (ROM), Erasable Programmable Read-Only Memory (EPROM or Flash Memory), Optical Fiber, Portable Read-Only Memory Compact Disc (CD-ROM), Optical Memory Components, Magnetic Memory Components, Or any suitable combination of the above.

The computer-readable recording medium may include a data signal in baseband or propagated as part of a carrier wave, carrying readable code therein. Such propagated data signals may take a variety of forms including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable recording medium can also be any readable medium other than a computer-readable recording medium that can transmit, propagate, or transmit data for use by or in connection with an instruction execution system, apparatus, or device. program. Code embodied on a computer-readable recording medium may be transmitted using any suitable medium, including but not limited to wireless, wireline, optical fiber cable, radio frequency (RF), etc., or any suitable combination of the foregoing.

Code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages—such as Java, C++, etc., as well as conventional procedural programming Language - such as the "C" language or similar programming language. The code can be executed entirely on the tenant computing device (device using multi-tenancy technology or multi-tenancy technology), partly on the tenant's device, as a stand-alone software package, partly on the tenant The on-computing device executes partially on the remote computing device, or executes entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the tenant computing device over any kind of network, including a local area network (LAN) or wide area network (WAN), or may be connected to an external computing device (eg, use an internet service provider to connect via the internet).

In an exemplary embodiment of the present invention, there is also provided an electronic device, which may include a processor, and a memory for storing instructions executable by the processor. Wherein, the processor is configured to execute the steps of the remote instant multimedia teaching method in any one of the foregoing embodiments by executing the executable instructions.

As will be appreciated by one skilled in the art, various aspects of the present invention may be implemented as a system, method or program product. Accordingly, various aspects of the present invention may be embodied in the form of an entirely hardware implementation, an entirely software implementation (including firmware, microcode, etc.), or a combination of hardware and software aspects, where May be collectively referred to as a "circuit," "module," or "system."

An electronic device 500 according to this embodiment of the present invention is described below with reference to FIG. 8 . The electronic device 500 shown in FIG. 8 is only an example, and should not impose any limitation on the function and scope of use of the embodiments of the present invention.

As shown in FIG. 8, electronic device 500 takes the form of a general-purpose computing device. Elements of the electronic device 500 may include, but are not limited to, at least one processing unit 510 , at least one storage unit 520 , a bus bar 530 connecting different system elements (including the storage unit 520 and the processing unit 510 ), and a display unit 540 .

The storage unit 520 stores program codes, which can be executed by the processing unit 510, so that the processing unit 510 executes the various exemplary embodiments described in the above section of the remote real-time multimedia teaching method of the present invention A step of. For example, the processing unit 510 may perform the steps shown in FIG. 1 and FIG. 3 .

The storage unit 520 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 5201 and/or a cache memory storage unit 5202, and may further include a read only storage unit (ROM) 5203.

The storage unit 520 may also include a program/utility 5204 having a set (at least one) of program modules 5205, such program modules 5205 including, but not limited to: an operating system, one or more application programs, other program modules Group and program data, each or some combination of these examples may include an implementation of a network environment.

The bus 530 may be representative of one or more of several types of bus structures, including a memory cell bus or a memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or using any of a variety of bus structures the local bus.

The electronic device 500 may also communicate with one or more external devices 600 (eg, keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable tenants to interact with the electronic device 500, and/or Communicate with any device (eg, router, modem, etc.) that enables the electronic device 500 to communicate with one or more other computing devices. Such communication may take place through input/output (I/O) interface 550 . Also, the electronic device 500 can communicate with one or more networks (eg, a local area network (LAN), a wide area network (WAN) and/or a public network such as the Internet) through the network interface card 560 . The network interface card 560 can communicate with other modules of the electronic device 500 through the bus bar 530 . It should be understood that, although not shown, other hardware and/or software modules may be used in conjunction with electronic device 500, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

Those skilled in the art can easily understand from the above description of the embodiments that the exemplary embodiments described herein can be implemented by software, or by a combination of software and necessary hardware. Therefore, the technical solution according to the embodiment of the present invention can be realized in the form of a software product, and the software product can be stored in a non-volatile computer-readable recording medium (which can be a CD-ROM, a USB flash drive, a removable hard drive) etc.) or on the network, including several instructions to enable a computing device (which may be a personal computer, a server, or a network device, etc.) to execute the above-mentioned remote real-time multimedia teaching method according to an embodiment of the present invention.

Compared with the prior art, the advantages of the present invention are: on the one hand, the present invention can provide a cloud desktop to an account located in the virtual interactive space through the establishment of a virtual interactive space, and the cloud desktop can be operated according to different account permissions to realize virtual interaction in the interactive space; on the other hand, the present invention allows the second type of account to change the permission of the first type of account through the permission association between the accounts, so as to manage the interaction in the course in an orderly manner; In one aspect, the present invention can provide cloud desktop and multimedia interaction without plug-in programs, and solve the problems of installing additional plug-in programs and complex networks in the virtualization process.

Other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the invention which follow the general principles of the invention and which include common knowledge or conventional techniques in the art not disclosed by the invention . The specification and examples are to be regarded as exemplary only, and the true scope and spirit of the invention is set forth in the appended claims.

However, the above are only examples of the present invention, and should not limit the scope of the present invention. Any simple equivalent changes and modifications made according to the scope of the application for patent of the present invention and the content of the patent specification are still within the scope of the present invention. within the scope of the invention patent.

S110~S160: Steps S171~S173: Steps 200: Display interface 201: Cloud Desktop 202: Teacher video area 203, 204: Student video area 205: Discussion area 310: First Terminal Equipment 311: The first multimedia acquisition module 320: Second terminal equipment 321: The second multimedia acquisition module 330: Control System 331: Communication module 332: Permission Management Module 333: Cloud Desktop Module 400: Remote real-time multimedia teaching device 410: Build Mods 420: Provide mods 430: The first operation module 440: First Change Mod 450: Second Operation Module 460: Second Change Mod 500: Electronic Equipment 510: Processing unit 520: storage unit 530: Busbar 540: Display unit 550: I/O interface 560: Network Interface Card 5201: RAM 5202: Cache memory storage unit 5203: ROM 5204: Programs/Utilities 5205: Program Module 600: External device 700: Program Products

Other features and effects of the present invention will be clearly shown in the embodiments with reference to the drawings, wherein: 1 shows a flowchart of an embodiment of a remote real-time multimedia teaching method according to the present invention; FIG. 2 shows a schematic diagram of the cloud desktop of the present embodiment; 3 shows a flowchart of multimedia control in the remote instant multimedia teaching method of the present embodiment; FIG. 4 shows a schematic block diagram of equipment included in an embodiment of the remote real-time multimedia teaching system of the present embodiment; 5 shows a block diagram of modules included in the control system in the remote real-time multimedia teaching system of the present embodiment; 6 is a schematic block diagram of modules included in an embodiment of the remote real-time multimedia teaching device of the present invention; FIG. 7 shows a schematic diagram of an embodiment of the computer-readable recording medium of the present invention; and FIG. 8 shows a schematic block diagram of a circuit included in an embodiment of the electronic device of the present invention.

S110~S160: Steps

Claims (11)

A remote real-time multimedia teaching method, comprising: a control system, in response to at least one first type of account corresponding to a first terminal device and a second type of account corresponding to a second terminal device corresponding to the reception of a course request, establishes a virtual interactive space associated with the at least one first-type account and a second-type account; the control system provides a cloud desktop to the at least one first-type account and the second-type account in the virtual interactive space, wherein all the The first type of account has the first type of permission, the first type of permission is not allowed to operate the cloud desktop, the second type of account has the second type of permission, the second type of permission to operate the Cloud desktop; the control system operates the cloud desktop in response to the operation instruction of the second type of account; the control system responds to the first permission instruction of the second type of account to the first type of account, so that the second type of account The first-type account corresponding to a permission instruction is changed from the first-type permission to the second-type permission; the control system operates the cloud desktop in response to the operation instruction of the first-type account with the second-type permission; The control system, in response to the second permission instruction of the second type of account to the first type of account, changes the first type of account corresponding to the second permission instruction from the second type of permission to the first type of permission; The control system, in response to the first control instruction of the second type of account to the first type of account, receives the first multimedia data of the first type of account corresponding to the first control instruction; The control system provides the first multimedia material of the first type of account to the second type of account in the virtual interactive space, and the first multimedia material is displayed in the cloud desktop or independent of the cloud desktop display; the control system, in response to the second control instruction of the second type of account to the first type of account, stops receiving the first multimedia data of the first type of account corresponding to the first control instruction; and the control In response to the action instruction of the first type of account, the system triggers the second type of account to generate a first permission instruction for the first type of account, wherein the action instruction is the corresponding one of the first type of account. The first terminal device is generated when a preset first action is recognized based on a video capture device or a wearable device corresponding to the first type of account. The remote real-time multimedia teaching method according to claim 1, wherein after establishing a virtual interactive space associated with the at least one first-type account and the second-type account, the method further comprises: the control system reporting to the virtual interactive space At least one first type of account in the account provides second multimedia data of the second type of account, and the second multimedia data is displayed in the cloud desktop or displayed independently of the cloud desktop. The remote real-time multimedia teaching method according to claim 1, wherein the first control instruction and the second control instruction control the multimedia collection device of the first terminal device corresponding to the first type of account. The remote real-time multimedia teaching method according to claim 1, wherein the first permission instruction triggers the first control instruction; the second permission instruction triggers the second control instruction. The remote real-time multimedia teaching method according to claim 1, wherein the control system associates the virtual interactive space with a management system in response to a request instruction of the first type of account and/or the second type of account in the virtual interactive space account, the management account corresponds to a management terminal device and has a third type of permission, the third type of permission allows the management account to change the relationship between the virtual interactive space and the first type of account and/or the second type of account Associate, allow the management account to modify the permissions of the first type of account and/or the second type of account, and allow the management account to operate the cloud desktop. A remote real-time multimedia teaching device, comprising: a creation module, in response to the receipt of a course request of at least one first-type account and a second-type account, establishing a relationship with the at least one first-type account and a second-type account A virtual interactive space for accounts; a providing module that provides cloud desktops to at least one first-type account and one second-type account in the virtual interactive space, wherein the first-type account has the first-type permission, so The first type of permission does not allow the first type of account to operate the cloud desktop, the second type of account has the second type of permission, and the second type of permission allows the second type of account to operate the cloud desktop. Cloud desktop; a first operation module for operating the cloud desktop in response to an operation instruction of the second type of account; a first change module in response to the second type of account for the first type of account A permission command to change the first type of account corresponding to the first permission command from the first type of permission to the second type of permission; a second operation module to respond to the first type of account with the second type of permission The operation instructions of the account-like account to operate the cloud desktop; and a second modification module, in response to the second permission instruction of the second category account to the first category account, so that the first category account corresponding to the second permission instruction is changed from the second category permission to the first category type permission; the establishment module receives the first multimedia data of the first type account corresponding to the first control instruction in response to the first control instruction of the second type account to the first type account; the establishment module The module provides the first multimedia data of the first type of account to the second type of account in the virtual interactive space, and the first multimedia data is displayed in the cloud desktop or independent of the cloud desktop display; the establishment module stops receiving the first multimedia data of the first type of account corresponding to the first control command in response to the second control instruction of the second type of account to the first type of account; the establishment module In response to the action instruction of the first type of account, the group triggers the second type of account to generate a first permission instruction for the first type of account, wherein the action instruction is a corresponding one of the first type of account. The first terminal device is generated when a preset first action is recognized based on a video capture device or a wearable device corresponding to the first type of account. A remote instant multimedia teaching system, comprising: a plurality of terminal devices, which are used as first terminal devices when the terminal devices are logged in with a first type of account, and used as second terminal devices when the terminal devices are logged in with a second type of account. terminal equipment; a control system for establishing a virtual interactive space associated with the at least one first terminal equipment and a second terminal equipment according to the course request, and controlling the It controls the interaction between the first terminal device and the second terminal device in the virtual interactive space, and includes: a communication module for communicating with each terminal device; a cloud desktop module for communicating with at least one terminal device in the virtual interactive space A first terminal device and the second terminal device provide cloud desktops, and operate the cloud desktops in response to operation instructions of various accounts; a permission management module is used to manage the permissions of various accounts, wherein, The permission management module responds to the first permission instruction of the second type of account to the first type of account, so that the first type of account corresponding to the first permission instruction is changed from the first type of permission to the second type of account Class permission, the permission management module responds to the second permission command of the second class account to the first class account, so that the first class account corresponding to the second permission command is from the second class permission Change to the first type of permission, the first type of permission is not allowed to operate the cloud desktop, the second type of permission to operate the cloud desktop; the control system responds to the second type of account to the first the first control instruction of a class account, and receive the first multimedia data of the first class account corresponding to the first control command; the control system provides the second class account in the virtual interactive space with the information of the first class account The first multimedia data, and the first multimedia data is displayed in the cloud desktop or independently of the cloud desktop; the control system responds to the second type of account to the first type of account. Two control instructions, stop receiving the first multimedia data of the first type of account corresponding to the first control instruction; In response to an action instruction of the first type of account, the control system triggers the second type of account to generate a first permission instruction for the first type of account, wherein the action instruction corresponds to the first type of account The first terminal device is generated when a preset first action is recognized based on a video capture device or a wearable device corresponding to the first type of account. The remote real-time multimedia teaching system according to claim 7, wherein the terminal device communicates with the cloud desktop module through websocket; the terminal device communicates with the communication module through webRTC. The remote instant multimedia teaching system according to claim 7, wherein the cloud desktop module is implemented based on a browser. An electronic device, comprising: a processor; and a memory, in which a computer program is stored, and the computer program is executed by the processor to execute the remote real-time multimedia according to any one of request items 1 to 5 teaching method. A computer-readable recording medium, the computer-readable recording medium stores a computer program, and the computer program can execute as described in any one of claim 1 to 5 when the computer program is run by a processor of a terminal device. The remote real-time multimedia teaching method described above.

Images